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ABSTRACT 

This exploratory study of 24 questions was conducted 
to gain information a.K>ut the perceptions, opinions, and practices of 
the social studies methods instructors of the College and University 
Faculty Assembly (CUFA) of the National Council for the Social 
Studies (NCSS). The study was undertaken to clarify and direct future 
research studies on citizenship education. The 321 CUFA members, of 
whom 103 responded, were questioned about their preference for one or 
more of the eight citizenship instructional approaches identified by 
Dynneson and Gross. The eight approaches included citizenship as: (1) 
persuasion, socialization, and indoctrination; (2) contemporary 
issues and current events; (3) the study of U.S. history, civics, 
geography, and related social science courses; (4) civic 
participation and civic action; (5) scientific thinking; (6) a 
jurisprudence process; (7) humanistic development; and (8) 
preparation for global interdependence. The respondents were also 
asked to give their assessments on the influence and impact of 
citizenship education on students and society, to assess perspectives 
on the eight approaches, and to address a definition of citizenship 
education. The most important recommendation originating from the 
survey was to shift the focus away from teacher education and move 
directly into the classroom environment in order to identify and 
attempt to measure what transpires within the school ♦ Each of the 24 
questions is reproduced with an analysis and accompanied by a graph. 
The appendix explains how the data were analyzed. (DJC) 
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ABSTRACT 



The research interests of the Citizenship 
Development Study investigators is to acquire 
information regarding the current status of 
citizenship education within the educational 
community in the United States. This monograph 
consists of an exploratory study of the opinions 
and practices of members of the College and 
University Faculty Assembly (CUFA), a subgroup of 
the National Council for the Social Studies. This 
membership generally represents university and 
college social studies methods instructors who are 
responsible for the education and training of 
social studies teachers. 

During 1986, members of the Citizenship 
Development Study Project developed a survey 
instrument thajt could be used to gather 
information from members of the College and 
University Faculty Assembly of the National 
Council for the Social Studies (henceforth, CUFA) 
regarding their preferences for one or more of 
eight citizenship instructional approaches. This 
initial study was designed as an exploratory study 
that could be used to help in the development of 
scientific surveys that would follow. The results 
of this survey were used to assist in the 
identification and clarification of concerns that 
would arise in the study of the status of 
citizenship education in the United States. 

The study provided a great deal of 
information on the citizenship education 
perspectives and practices of college and 
university educators. These perspectives and 
practices have been separated into subsections in 
the monograph, in addition to information about 
the processes and procedures of the study, the 
monograph addresses consensus and the definitional 
problem associated with citizenship education. 
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THE CITIZENSHIP DEVELOPMENT PROJECT 

In recent years, the United States has been the scene of a tidal wave 
of immigration from every culture and society in the world. Languages and 
cultures are so numerous that they form a conglomerate of diversity that 
would swamp and paralyze most other societies. Assimilation is the test 
of the survivability of democracy, and a continuing process that 
contributes to the vitality of democracy. Historically, American 
citizenship has effected by the consequences culturally pluralistic 
society, but never to the extent that pluralism exists today. Since the 
days of Jefferson, three fundamental factors have been used to forge 
diversity .within the united pluralism. These factors have included a 
.democratic ideology, a common educational experience that promotes a 
unity in the face of social differences, and a shared willingness to accept 
diversity as a perceived good in society. 

American citizenship can be seen as the by-product of three factors 
th?t include democratic government, public education, and a culture that 
can be described as a united pluralism. The interaction among these 
factors has produced a socialization process quite different from most 
socialization processes found in other nations, or societies. These 
socializing processes is what makes American citizenship different and 
vital. In order to understand the mechanisms of the socializing processes 
associated with citizenship development in the United States, we are 
required to study the interactions of ideology, education, and cultural 
pluralism as they are manifested in educational programs and in the 
processes of child development. The means anu methods for 
understanding these complex social phenomenons consist of intellectual 
and research processes. The capital goal of this inquiry is to explore the 
current status of citizenship education and come to an understanding of 
the dynamic social processes that influence its development, 

A research interests of Citizenship Development Study Center 
investigators is to acquire information regarding the current status of 
citizenship education within the educational community in the United 
States. This monograph consists of an exploratory study of the opinions 
and practices of members of the College and University faculty Assembly 
(CUFA), a sub-group of the National Council for the Social Studies. This ' 
membership generally represents university and college social studies 
methods instructors who are responsible for the education and training of 
social studies teachers. 
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\. CHARACTERISTICS OF THE CUFA SURVEY 



During 1986, members of The Citizenship Development Study Project 
developed a survey instrument that could be used to gather Information 
from members of the College and University Faculty Assembly oi the 
National Council for the Social Studies (henceforth, CUFA) regarding their 
preferences for one or more of eight citizenship Instructional approaches. 
This initial study was designed as an exploratory study that could be used 
to help in the development of scientific surveys that would follow. 
Because of the exploratory nature of this study, the researchers did not 
attempt to plan or execute attempts to Increase the number of survey 
returns. At the.same time, the 32 % response rate was considered fairly 
substantial given our initial expectations. The results of this survey were 
used to assist in the Identification and clarification of concerns that 
would arise in the study of the status of citizenship education in the 
United States. Therefore, in reporting the results of this initial survey we 
are labeling the study and its results as exploratory. This study will raise 
many questions and issues that will require a more specific type of 
inquiry-an inquiry in which specific in-depth Investigation can be 
pursued. 

Because we are especially concerned with the actual practices that 
social studies methods instructors use within the United States, 
additional investigations are necessary in order to complete the findings 
of this report. This exploratory study simply reflects the thinking of a 
sample of CUFA members who responded to the mail-out survey. The 
value of an exploratory study as described in this report is that it helps to 
clarify issues and directions. At the same time, an exploratory study 
often raises issues and questions that may not have otherwise been 
recognized. 

Eight Citizenship Approaches 

These eight approaches were identified originally by Dynneson and 
Gross in a 1982 article that appeared in September/October issue of The 
Social Studies. The eight approaches included the following: 

1. Citizenship as Persuasion, Socialization, and Indoctrination. 

2. Citizenship as Contemporary Issues and Current Events. 

3. Citizenship as the Study of American History, Civics, 

Geography and Related Social Sciences. 
4 Citizenship as Civic Participation and Civic Action. . 
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5. Citizenship as Scientific Thinking. 

6. Citizenship as a Jurisprudence (legalistic) Process. 

7. Citizenship as Humanistic Development (concerns for the 

total welfare of the student). 

8. Citizenship as Preparation for Global Interdependence. 

A brief description of each approach was included with the survey 
instrument. The 1982 article contained an extensive description of each of 
the eight approaches. 

THE GOALS OF THE SURVEY 

The goals of this component of research were the following: 

1. To identify the nature of citizenship education, including its varied 
approaches. 

2. To gain insights into the currer.. status of citizenship education as 
seen through the perspectives and practices of social studies methds 
instructors. 

3. To identify issues, concerns, problems, and questions that need to be 
addressed and resolved in regard to the education of social studies 
teachers. 

4. To identify sources of influence, both educational and social, that 
contribute to citizenship development. 

5. To gain insights into the extent to which social studies methods 
instructors agree or disagree on educational approaches to citizenship 
educa*'on. 

6. To gain insights into theextent to which social studies methods 
instructors agree or disagree on a definition for citizenship education. 

THE IMPORTANCE OF THE SURVEY 

The investigation of the thoughts and opinions of CUFA members 
regarding citizenship education in the social studies was undertaken in 
order to gain information about the perceptions and practices of social 
studies methods instructors. The results should contribute to the overall 
study of citizenship education in the United States. Information collected 
from this group eventually will be compared, contrasted, and combined 
with information from other groups including teachers, administrators, 
and students. In total, this data should become the basis for a broader 
picture of the status and the importance of citizenship education in the 
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social studies. 

Through the survey of CUFA members, we can gain new 
insights into the current status of citizenship education according to the 
following issues and concerns: 

1. The patterns that exist in terms of respondents' preferences and 
practices in citizenship education. 

2. The respondents' assessment of the influences (especially persons 
with whom the student has direct contact) that affect citizenship 
development. 

3. The respondents' assessment of the impact of citizenship 
education on citizenship behavior. 

4 The respondents' assessment and preference of attributes that 
help define or identify the "good" citizen. 

5. The respondents' preference for some of the eight recognized 
approaches to citizenship education that have been described and 
recommended in social studies literature. 

6. The respondents' use of the eight approaches to citizenship in 
social studies methods courses for teacher candidates. 

7. The extent to which the eight approaches to citizenship are valued 
and assessed by respondents. 

8. The identification of adoptions and modifications to citizenship 
education in light of the perceived needs of students. 

9. The identification of influences that contribute to variations in 
citizenship education programs for students. 

10. The extrapolation of the information to other specific elements of 
social studies. 



THE DESIGN OF THE SURVEY ~ 

The survey of CUFA members is the first of several components of a 
larger study on the status of citizenship education in the social jtudies. 
(Four identified populations include social studies methods instructors, 
teachers, administrators, and students.) The results of the study should 
provide information that will be the basis for describing of the a, rent 
thoughts and practices of social studies methods instructors on the 
current status of citizenship education. The results of this survey should 
lead to the identification of more specific issues and problems pertaining 
to citizenship education in the social studies as seen through the eyes of 
those surveyed. The design of the study is based on the following 
activities: 



The Review of Literature 

The literature review spans a fifty year period from which books, 
Journals, and articles that pertained to citizenship education were 
analyzed for recommended approaches. Journal articles were of particular 
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importance to this review, including Social Education, whirh hag served as 
the official voice of the National Council for the Social Studies. The 
library search focusedon articles that recommended different approaches, 
to the teaching of citizenship education. As a result of this search, eight 
separate approaches to citizenship education were identified, later these 
eight approaches were reported in the September/October 1982 issue of 
the Social Studies in an article entitled "Citizenship Education and the 
Social Studies: Which is Which?" These eight approaches became the basis 
for an .nquiry into the status of citizenship education. 

The Questionnaire 

A questionnaire was developed in which the eight approaches 
identified in the 1982 article were the basis for inquiring into the status 
of citizenship education in the social studies. The questionnaire was 
designed to collect. information about perceptions, practices, and 
preferences 'Staining to citizenship-education in the social studies. The 
questionnaire contained broad-based; aestlons which became the focal 
point for identifying specific concer i and issues that would lead to more 
in-depth inquiries in future studies. The questionnaire had three parts. 
The respondents were asked to ( 1) give the.. - assessments on the 
Influences and impact of citizenship education on students and society, 
and to clarify items related to attributes of what might be considered a 
"good" citizen, (2) assess perspectives on the eight approaches to 
citizenship education, and finally (3) address a definition of citizenship 
education in which respondents were asked whether or not they would 
accept the definition as stated. Those who did not accept the definition 
were given an opportunity to modify the definition In order to make it- 
acceptable. 

The questionnaire was reviewed by a small number of social studies 
methods instructors, approximately sixty-five prospective elementary and 
secondary teachers, and a public relations specialist who had had school 
district experience in the development of questionnaires. After several 
modifications, a final draft of the the questionnaire was printed. 

THE POPULATION AND SAMPLE 

The survey was sent to CUFA members as representative of the 
population of social studies methods instructors currently teaching at the 
colleges and universities in the United States. The members residing in 
the United States consisted of a group of approximately 321 individuals, 
of which 1 03 completed returned a questionnaire. This providing an 
exploratory sample of 328. 

CUFA members mainly consist of college andvuniversity faculty 
members who typically teach social studies methods courses in schools 
and departments of education. Through the survey, the perceptions, 



opinions, and practices of social studies methods instructors in general 
can be obtainedirom a segment of social studies methods professionals 
who should be the most informed. A current mailing list of CUFA members 
was acquired from the office of the National Council for the Social 
Studies, and;,these members were used as the study population. The survey 
was sent to all members of CUFA; however, only United States respondents 
were included in the analysis of data. The questionnaire was sent again to 
the. CUFA membership in order to solicit. responses from those who did not 
return the initial survey. The follow-up survey was analyzed as a 
separate study; the;results were compared and contrasted with the results 
of the initial survey as a check of validity. 

Respondents Knowledge -* 

The questionnaire contained two items (Questions *13 & 14) that 
served as a check on respondent's knowledge of the eight citizenship 
approaches. The items and their results are described below: 

Item: 

Question*! 3 

Are you familiar with all eight approaches? (yes/no) If not, please 
designate the approaches you are least familiar with. (A list of the eight 
approaches followed the above question). 

Survey Result: 

Eighty-eight indicated that they were familiar with the eight approaches, 
thirteen were not, and two did not respond. This result gave an 87.1 % yes 
response. 

To provide for sampling variability, a confidence interval estimate was 
made indicating that at the 95% confidence level one can assert that the 
true percentage of yes responses should lie in the interval from 806% to 
93.62. * 

(see chart for Question* 13) 
Inferences: 

1. The great majority of social studies .methods instructors were familiar 
wtth all eight of the citizenship approaches. 

2. A small minority of social studies methods instructors were not 
familiar with, or they did not approve of the term "scientific thinking." 



3. A small minority of social studies methods instructors were not 
familiar with "humanistic development" 

4 Very few social studies methods instructors were not familiar witn 
"persuasion, socialization, and indoctrination." 

5. Very few social studies methods instructors were not familiar with 
"jurisprudence process." 

Item: 

Question *H 

Designate the approaches that are Included in your instructional program. 
• (A list the the eight approaches followed the above question) 

Survey Result: 

(see chart for Question * 14) 

Inferences: 

1. To a relatively large statistical extent, all eight citizenship 
approaches can be found in most college and university level social studies 
methods courses that currently are used for the preparation of elementary 
and secondary teachers. 

2. "Contemporary issues and current events," the "study of American 
history, civics, geography and related social sciences," "civic participation 
and civic action," "scientific thinking" and "preparation for global 
interdependence" were designated as approaches that were most commonly 
included in social studies methods courses. 

3. "Persuasion, socialization, and indoctrination," "jurisprudence process," 
and "humanistic developmer.*" were designated as approaches that were 
less commonly included in social studies methods courses. 

Discussion 

In general, the respondents Indicated that they were familiar with all 
eight of the citizenship approaches. Of those who commented on 
"scientific thinking," a few objected to its use as appropriate terminology. 
Some preferred another term such as "inquiry" or "problem solving;" 
however, most of those who objected on usage grounds were fairly well 
aware of the characteristics of this approach. The term "scientific 
thinking" has its origins in the work of John Dewey and is related to 
scientific problem-solving. While other terms may be more appropriate in 
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light of current pedagogical developments, this term has some historical 
significance. 

While the respondents indicated that all eight approaches were included in 
their instructional programs, the amount of instructional time spent on 
each approach and the degree of emphasis were not determined, in 
addition, the study did not include any provisions for identifying the 
various methods or types of materials that were Included for instruction 
in each of the eight approaches. As a result, these researchers are 
reluctant to assume that extensive time and effort Is extended to more 
than two or three of these approaches. 

THE ANALYSIS OF DATA 

A detailed description of the techniques used in the analysis of data 
is contained in the Applendix of this report. 
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II. DEVELOPING AND TESTING 
A PROJECT DEFINITION FOR "CITIZENSHIP EDUCATION" 

Citizenship education has been the subject of comment, study, and 
program development for many years, and yet there Is a general reluctance 
on the part of educators to define citizenship education In clear and 
unequivocal terms. After several attempts to Identify and describe the 
Important characteristics of citizenship education, a working definition 
was drafted and included in the exploratory survey for CUFA members. The 
purpose of Including the definition was to obtain an indication of expert 
thinking and opinion on the subject. 

Developing a Working Definition 

The CUFA questionnaire attempted. to develop and test the 
acceptability of a definition for the term citizenship education. 
Respondents were asked to review the prescribed definition and to accept 
the statement intact, or to accept the statement with their specifically 
imposed modifications. The statement and its corresponding results are 
included below. 

Item: 

Question 24 

Do you accept the following definition of citizenship education or how 
would you modify it to meet your conception of the term? 

'While an Important and central element of the social studies, 
citizenship education Is a responsibility of the entire school (as 
well as of family and community). It Includes the means by 
which Individuals are prepared to gain the knowledge, skills and 
values that enable them to understand, examine, decide and 
participate In public affairs and In (the means for) forwarding 
the well-being of other Individuals and of their society." 

Survey Result: 

This statement was accepted by 69.8% of those responding. It can be 
asserted with 95% confidence that the response lies within the Interval 
60.6% - 79.0%. 

Respondents' Recommended Modifications 
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1. Comment be added to the end of the definition to read — "to 
relate In a human way with Individuals In other cultures." 

2. Insert the phrase — "means by which Individuals are^made 
aware of their own responsibilities and of moral ethical 
codes of society and are 'encouraged and prepared to gain 
the knowledge...." 

3. Change the last line to read — "forwarding the well-being 
of themselves and other individuals and of their society." 

4 Change the second sentence to read — "it includes the means 
by which individuals growing up in the United States are 
prepared...." — Add the following statement to the end of 
the last sentence — "as part of an interdependent global 
community with competing definitions of the role and 
responsibilities of citizens." 

5. That we recognize and appreciate cultural pluralism. 

6. Insert "nation" at the end of the first sentence to read — 
"(as well as of family, community and nation)" — Add the 
follow.lng statement to the last sentence ~ "3s well as 
provide opportunity to apply their current level of knowledge, 
skills, and values through participation In public affairs." 

7. Include world or global community membership/citizenship 
among the specified components to be understood, examined, 
etc. 

8. Change the statement to address how citizenship behaviors 
are expressed in a democracy by redefining democracy 

in light of each generation's ability to act and to solve 
their social problems. 

9. Omit the following words from the last sentence — "of 
other Individuals." 

10. Omit "prepare" In the second sentence of the definition. "I 
would suggest another word Instead of 'prepare,' In addition 
to, 'learning,' 'participating,' 'experiencing/involved In.' ^ 
Use words that suggest learning as involved the everyday I 
experiences of children In the schools as active 

citizens when learning (not preparing for age 18 or whatever) 
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would be more appropriate." 

1 1. Modify the second sentence to read — "It includes the 
means by which individuals are prepared to gain the values, 
knowledge, and skills that enable them to understand, 
make decisions, and participate in public affairs...." 

12. Change the emphasis of the definition to Include more 
emphasis on the need for students to participate In activities 
related to promoting citizenship education. 

13. Add a statement to the last sentence — "and become rational 
decision makers in a democratic society." 

14. Insert the word "commitment" in the second sentence so that 
it reads — "It Includes the means by which individuals are 
prepared to gain the knowledge, skills, values, and commitment 
that enable...." The respondent argues that "As a society we have 
to encourage commitment to democratic processes as part 

of public school preparation." 

15. Change "of society" in the last sentence to "of the global 
community." 

16. Respondent calls for a word usage change — "I do not equate 
/enable them to participate' with 'instruction that includes 

political participation." 

17. The last sentence to read — "and in forwarding the well-being 
of oneself, others; and the society as a whole." 

18. The second sentence should read — "knowledge, skills, values, 
and experiences...." 

19. Eliminate the beginning of the first sentence so that it begins 
with "Citizenship education...." 

20. Realize that, — "Not only does it include the means, it 
(citizenship education) requires students to use those means 
as a participant in citizen endeavors outside of school hours." 

21. Eliminate the first phrase of sentence one and begin the 
sentence with "Citizenship education...." 
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DISCUSSION 

While survey results indicated that the majority of respondents 
(69.8%) were willing more or less to accept our working def inition of 
citizenship education, a respectable number of respondents suggested 
some modifications. As a result of this survey, our definition wilj'be 
subjected to-a review and undoubtedly some minor revisions wllUbe made. 

The central features of the project definition will continue to 
emphasize four principles that define the meaning of citizenship 
education. These principles include: 

1. The means whereby- American youth acquire citizenship knowledge, 
skills and values. These means include both the social and educational 
influences that shape, direct and reinforce citizenship behaviors. 

2. The acquisition of student competencies that are considered a 
prerequisite to a meaningful.and competent American citizenship. These 
competencies Include the abilities related to understanding, examining, 
deciding, and participating in community affairs in order to contribute to 
the public affairs. 

3. T^he acquisition of student values and attitudes that encourage 
participation in the activities that forward the well-being of other 
individuals in society. 

4 The acquisition of student values and attitudes that encourage 
participation in activities that forward the well-being of society aUarge, 
especially in connection with the institutions of society. 

A definition of citizenship education helps to specify the roles and the 
responsibilities that schools must shoulder in the education of youth for 
citizenship. The clarification of related terms will be addressed 
according to the specifics of their application. 
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III. ANALYSIS AND RESULTS 



The results from the pJFA survey were analyzed according to the 
following statistical procedures: 

The Clopper-Pearson Confidence Interval 

The Chl-Square Goodness of Fit Test 

A Distribution-Free Test for Ordered Alternatives 
Based on Page's Adaptation of Friedman Rank Sums 



Each question was treated separately according to charateristlcs of the 
Item and the data resulting from the survey. In sections IV, V, and VI, the 
project Investigators reviewed the results of the analysis of data by 
exploring various interpretations and inferences that emerged from the 
survey. The interpretations and inferences will serve as the basis for 
further Investigation into the concerns that were raised in the CUFA 
survey. In addition, new research Instruments have been developed as a 
direct consequence of the survey. 



20 

12 



THE CLOPPER-PEARSON CONFIDENCE INTERVAL 

The standard estimator for the,probab111ty of a success or other 
specific response to a dlchotomous random variable is givitftfy the 
ratio of the number of favorable responses to the total number of trials. 
This estimator, ft is the observed relative frequency of successes 
in an experiment Involving Bernoulli trials. 

The estimatof^ alone is Inadequate for most statistical 
interpretations. A confidence interval on this estimator provides 
additional useful information. The method accredited to Clopper and 
Pearson is the standard frequently used. In this study, the number of 
observations are' on the order of 100 and consequently a large sample 
approximation of the Clopper-Pearson estimator is used. This is given by 
a normal approximation of the Binomial distribution. 

Let PI (a) be lower bound and Pu(a) be the upper bound corresponding 
to the (1 - a) confidence Interval, then 

P{P1(a)<p<Pu(a)J >= 1 - a 

where 

P1(a)-?-Zft[p(1 -p)/n] 

PuO^ + z^lpd -ty/n] 

n « the number of observations 

z^ A « the standard normal variable estimator 

and 

£ « the estimator of the probability of success 

For smaller sample sizes, the lower and upper estimators of the 
confidence interval are described In terms involving the Snedicor F 
distribution (Hollander and Wolfe, p. 24). 
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CH!~SQUARE GOODNESS OF FIT TEST 



The Chi Square Goodness of Fit Test is directed towards the 
determination Of the presence of discrepancies between the observed 
frequencies and the expected hypothetical frequencies. In these 
problems, the observed frequencies are the number of respondents 
indicating the given response. The hypothetical frequencies are determined 
from the expected distribution of responses as determined by an Initially 
given model. The null hypothesis of the statistical study is essentially 
that the observed data fits the model. The modeVused in most of these 
questions Is one of assuming that all responses will be uniformly 
distributed, that is, there is no preferred response. 

To enhance the validity of this test, the sample should be sufficiently 
large to assure that five or more responses are found in each interval. 
This also can be accomplished by combining some of the adjacent 
intervals. 

Critical values of the test statistic are dependent on the 
degrees of freedom in the analysis. For the one way distribution 

Investigated, the degrees of freedom are one less than the number of 
Intervals in the model. For the questions at hand, the following critical 
values of the Chi-square statistic are used. 





Levels of Significance 


df 


0.05- 


0.025 


0.01 


0.005 


1 


3.84 


5.02 


6.63 


7.88 


2 


5.99 


7.38 


9.21 


10.60 


3 


7.81 


9.35 


11.34 


12.84 


4 


9.49 


11.14 


13.28 


14.86 


5 


11.07 


12.83 


15.09 


16.75 


6 


12.59 


1445 


16.81 


18.55 


7 


14.07 


16.01 


18.48 


20.28 


8 


15.51 


17.53 


20.09 


21.96 


(This data was taken from Table A-6a of Dixon 


&Massev. Intrtduction to 


Statistical Analysis Mrfirau/ will \QR7\ 
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A DISTRIBUTION-FREE TEST FOR ORDERED ALTERNATIVES 
BASED ON PAGE'S ADAPTATION OF FRIEDMAN RANK SUMS 

The problem of determining whether or nota rank order exists for the 
attributes of questions 15, 16, and 17 has been addressed through an 
adaptation of a procedure developed by E. B. Page In 1963. This procedure 
Is designed to test the alternate hypothesis of ordered 
alternatives against the null hypothesis, all ranks being equal. 
Rejection of the null hypothesis provided statistical data to support 
that at least one of the Inequalities in the ordering Is strict. Page's test 
1s based upon a distribution-free test developed by Friedman, Kendall, 
and Bablngton Smith. 

When data Is rank-ordered, as is the case with the questions under 
Investigation, there is the problem of assessing the equivalence when 
attempting to analyze results. This reference is further complicated by 
the unknown "distances" between the various ranks. 

The procedure as- adapted to this analysis takes the observed number 
of respondents corresponding to a given rank-order for each of the eight 
strategies. Looking at each in turn, the strategies were ranked according 
to the number of respondents designating that rank. Ties were resolved bv 
using arithmetic means. 

Because the blocks in the analysis are ranks, the ranks of the 
attributes had to be modified from those employed by the Friedman 
rank-sum analysis. To do this the ranks of the attributes were obtained 
by using a weighted mean. Those at the I level were multiplied by eight, 
those at the 2 level by 7, etc. The method of obtaining these ranks Is the 
primary deviation from the Page procedure. 

The weighted means were then ordered by increasing magnitude, and 
as an ordered array, used to create the required L statistic of Page. 
This statistic is given by the following formula: 

L«R1 *2*R2 *3*R3*... ♦ 8*R8 

where * indicates multiplication. Critical values for this statistic with 
eight treatments or strategies and eight blocks or ranks are as follows: 

Levels of Significance 

0.050 0.010 0.001 
1,371 1,401 1,433 



9Q 

*4l O 



15 



(This data was taken from Table A- 16 of Hollander and Wolfe, 
Nopparametric Statistical Method, Wiley-lntersdence, 1973) 
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THE ANALYSIS OF QUESTION *1 



Question: At what age level should children receive specific instruction in 
citizenship? 



Hypothesis: Respondents feel that children should be given specific 
instruction in citizenship at all age levels. 

The calculated Chl-square statistic has a value of 10.073, larger 
than 9.48, the critical value of a 5% level of significance. This leads to 
the rejection of the null hypothesis. Thus respondents did not feel that 
citizenship instruction should be given "at all age levels. 

If the preschool age level is eliminated from the survey, the resultant 
Chl-square statistic has a value of 0.18, leading to the conclusion that 
essentially the same number of respondanfs advocated citizenship 
education at each school age level. 

The proportion of respondents recommending that citizenship be 
taught to preschoolers is 41.7%. Using a large sample approximation of 
the Clopper-Pearson confidence interval for dichotomous data gives us a 
95% confidence interval, 32.2% - 51.3% for the probable percentage of 
individuals advocating citizenship Instruction for preschoolers. 

Interestingly, only about 71% of the respondents indicated that 
citizenship should be taught at each of the levels indicated. 



3-5 years 
10 - 12 years 
16 - 1 8 years 



43 
68 
71 



6 - 8 (9) years 69 
13- 15 years 72 
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Rtcommendtd, (• L«v«l for Citizenship Instructors 
19S9 - 86 Sun*y 




1 ■■ r _ r 

At what age level(s) should children 
receive specific instruction in 
c i 1 4 zensh i p? 

Testing at the 5% level of significance that all ages are suitable 
for teaching citizenship, the hypothesis is rejected. The hypothesis;, 
however, would be accepted at the 2.5% level of significance.' 

Deleting the preschool' age group, the Chi-squaie statistic has the 
value of 0.18, leading to the consensus that Citizenship should be 
taught in all school age levels. 



THE ANALYSIS OF QUESTION *2 



Question: Should citizenship be taught primarily as a separate social 
studies subject or as an integrated part of the regular social studies 
curriculum? 



Analysis: In analyzing this data, only those responses indicating a 
separate or integrated course were considered. The proportion or 
respondents that indicated an integrated approach were then calculated. 
Also calculated was a Clopper-Pearson estimate of the 95% confidence 
interval. 

The purpose of the confidence interval is to permit one to identify an 
interval in which that the value of the true or population value can be 
expected to be found with odds of 19 to 1. 

The observed proportion recommending an integrated program in the 
elementary school was 949%, with a 95% confidence Interval of 87 3% 
- 97%. 



19 
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Citizenship as a Separate or Integrated Subject 
1985 -8* Survey 



ttJDHKTWr 
SCHOOLS 



SCHOOU 
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snutuns subject 

Structure Strategy Recommended 
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Should citizenship be taught primarily 
as a separate social studies subject 
or as- an integrated part of. the regu- 
lar social studies curriculum? 
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Neglecting the "no response?" 94.9% voted for an integrated 
program within the elementary schools. Based on the number 
responding, this yields a confidence interval with a 95% J 
probability that the true percentage of those recommending 
an integrated course lies in the interval of 90.5 - 99.3%. 

For the secondary level, 92.5% recommend that the program be 
integrated. The 95% confidence interval for this ranges from 
87.3 to 97.9%. 



THE'ANALYSIS OF QUESTION *3 



Question: Which of the following is the most valuable in the formation of 
citizenship values? 



Hypothesis: The source of citizenship values is the same for both 
elementary and secondary students. 

The response pattern to this data is such that a statistical analysis 
was not warranted. It is worthy of note that the influence shifted from 
parents for elementary school students to friends, and in a more limited 
way, to teachers when students were in the secondary school. 



parents 
friends 

religious leaders 



teachers 
siblings 
others 
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Source of Cibztnship Valuta 
1985 - 86 Survey 



nfyomitr 

SCHOOLS 



sceoNOMvr 

SCHOOLS 



too 



FAftCXTS 



mcNou 



motes sauNos mluaocrs 
Primary Source of Looming Cftizonohip 



_E3_ 



OTHOtt 



Which of the following is most influ- 
ential in the formation of citizen- 
ship va I ues? 

In elementary school 

(please select one) 



In secondary school 

(please select one) 
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THE ANALYSIS OF QUESTION *4 

Question: Which of the following is the most Influential In the formation 
of citizenship knowledge? 



Hypothesis: The source of citizenship knowledge Is the same for both 
elementary and secondary students. 



Again the distribution of data does not warrant a statistical analysis. 
It is Interesting to note that the Influence In forming citizenship 
knowledge by teachers Increased only slightly in going from elementary to 
secondary school. The Influence of parental knowledge, however, was 
perceived to drop from 27% to 6& 

The development of peer recognition in going from elementary to 
secondary school is also weakly indicated. None indicated the Influence of 
■friends as primary for elementary students, but it jumps to 6% for 
secondary students. 

The shifts in primary Indicators Is not as marked as it was for the 
previous question involving the agent of Inf luence on values. 



parents 
friends 

religious leaders 



teachers 
siblings 
others 
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Source of Citizenship Knowledge 
1965 - 66 Surrey 
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PARENTS 
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Primory Source of Citizenship Knowledge 



ich of the following is most influ 
ntial in the formation of citizen- 
h i p. know ledge? 



n elementary schoo 

(please select one) 



In secondary school 

(please select one) 
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THE ANALYSIS OF QUESTION *5 

Question: Which of the following is most Influential in the learning and 
practice of citizenship skills? 



Hypothesis: The source of citizenship skills is the same for both 
elementary and secondary students. 

In looking to this question, the role of the teacher seems to remain 
constant. There is, however, a perceived shift from parents to friends as 
the students change from elementary to secondary schools. 



parents 
friends 

religious leaders 



teachers 
siblings 
others 
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Souret of Citizenship Skills 
1905 - 06 Survoy 



SCHPOU 

E 5SS 3 



SKCONQAMV 
SCHCOU 



ICQ 




MMNTS 
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Primory Source of Cltfzonohfp Skills 



N\>1 
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Which of the fol lowing is most influ- 
ential in the formation of citizen- 
ship skills? 



In elementary school 

(please select one) 

In secondary school 

(please select one) 
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Influencing Factors in Elementary Schools 
1985 - 86 Survey 

KNOWLEDGE 

EZZZZl 



SKILLS 

rz zzzm 




TEACHERS 



FRIENDS 



SIBLINGS 



REL LEADERS 



OTHERS 



No Roiponso 



Primary Source of Influence 
CompotlU of quootiono 3, 4 and S for Elomontary Schools 



Influencing Factors in Secondary Schools 
1985 - 86 Survey 

VALUES KNOWLEDGE SKILLS 

E52ZZ3 • EZZZZI X7777m 

100, — 



80 



80 



40 
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PARENTS 
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1 



/ 4 

£>'< 
'-'1 



J 



TEACHERS 



FRIENDS 



SIBLINGS 



JS£3Z2_ 



/ 4 

' / 
/ / 



REL LEADERS 



OTHERS 



No R«ipont« 



Primary Source of Influence 
Composite of questions 3. 4 and S for Secondary Schools 
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THE ANALYSIS OF QUESTION * 6 



Question: Do citizenship Instructional programs vary according to the 
following attributes of students: race, religion, ethnic affiliation, 
political background, economic background, social background, student 
ability, student experience, community characteristics? 

Analysts: 82.2% of the respondents Indicated that citizenship programs 
vary accordlng.to student attributes. Using a large sample estimate of the 
Clopper-Pearson confidence interval, the expected true value can be 
assumed to lie in the Interval 72.2% - 88.2% with 95% level of confidence. 

This question suggests, further areas of research aimed at 
investigating the nature of the changes as well as which attributes are 
correlated most to the changes. One could also ask if teachers teach 
toward a norm, or do they merely accommodate? 
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Question 6 



Do citizenship instructional programs 
vary according to the following attri- 
butes of students : . 

race, 

re I i g i on , 

ethn ic af f i I i at ion , 
po I i t i ca I background , 
economic background, 
soc i a I background , 
student ab i I i ty , 
student experience, 
community characteristics? 

* 

Eighty two point two percent (82.2%) responded yes. 

The 95% confidence interval for a yes response is 
72.2-88.2%. 



It is worth observing that thirty two (32) of those 
responding suggested additional factors as requested. 
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ITEM «6 RESPONDENTS* V 1ST OF OTHFR FAfTnPg 



Student Attributes: 

Academic Ability 

Gender 

Interests 

Learning Styles 

Handicaps 

Prior Knowledge 

Developmental Level 

Youth Group Membership 

Friends 

Siblings. 

Parental Attitude- and Values 
Parental Level of Education 

Teacher Attributes 

Background 

Professional Affiliation 

Responsibilities 

Perception of Citizenship 

Knowledge 

Skills 

Ability toTeach 
Religion 

Personal Qualities 
Political Perspective 
Attitudes and Values 
Motivation 

Commitment to Citizenship Development 

Community Attributes 

Predominant Values and Attitudes 
Region of Nation 
Social Expectancies 
Qualities of Leadership 
Socio-economic Standards 
Interests 

Financial Support for Education 

Program Attributes 

Nature of the Program 
Level of Indoctrination 

Nature of the Curriculum . 39 
Textbook Adoption Procedures 



School Atmosphere and Environment 
Graduation Requirements 
Budget 

Staff Development 
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THE ANALYSIS OF QUESTION *7 



Question: What teaching strategy(les) Is (are) most compatible with 
citizenship education content? 



Though seven items are being ranked, It Is not always possible to 
distinguish between two adjacent ranks; this Is particularly true of 6 and 
7 because of the nebulous "other," which may or may not have been 
significant. 

Assuming that ranks 1 and 2 would be high, they were lumped into one 
category. Similarly ranks 6 and 7 were combined. 

One obvious conclusion is that the lecture-mode is considered as the 
least compatible teaching strategy for citizenship education. 

At the other extreme, "Discussion" and "Inquiry" are considered the 
most compatible. 

The rankings of "Small groups," "Simulation" and "Role playing" are 
reasonably well distributed across all but the lowest ranks. 



lecture 
discussion 
simulation 
other 



small group work 

Inquiry 

role playing 
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Ronking of Citizenship Teaching Strategies 
1985 - 86 Survey 



RANKS 
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Teoehtng Strategy 

\7 



at teaching strategy(ies) is (are) most 
compatible with the citizenship education 
con ten t? 



(please rank order) 

lecture 

sma I I group work 
d i scuss i on 
i nqu i ry 
s imu I at ion 
role p I ay i ng 
other 

42 
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THE ANALYSIS OF QUESTION *8 



Question: What do you estimate to be the overall percentage influence of 
education on the development of citizenship in American society? 

90% 70% 50% 30% )0% 

Analysis: The percentage estimate of educational Influence on 
citizenship has a mean of 37.2%-with a standard deviation of 15.96. 

The median Is a better estimator to use in this situation: the 
percentage estimates of half the respondents will be less than the median 
value, and of course, fifty percent indicate more. The value of the median 
is 35.6%. 

Pursuing the analysis further, twenty-five pereent of the respondents 
felt that education influences less than 25.6% of the development of 
citizenship. Furthermore, only 25% consider that education has more than 
a 48.75% influence on citizenship development. 

This poses the question as to the source of the additional 50% of the 
influence. 
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Percentage Influence of Education on Cfttzenshfp Development 
1965 - 86 Survey 




™* »•* MX 

Pereentogee Estimated 



What do you estimate the overall percentage 
influence of education on the development 
of citizenship to be in American society? 

(please select one) 

90% 70% 50% 30% 10% 



Mean percentage 

Standard -dev 

Median percentage 
Quar t i I e ran 



37.2 

iation 15.9 
35,6 

ge 25.6 - 48.7% 



THE ANALYSIS OF QUESTION *9 

Question: What Is the most Important attribute for effective Instruction 
In citizenship education? (please select one) 

knowledge of government 
exemplary behavior 
concern for students 
classroom-organization and approach 

Hypothesis: Each of the four attributes is equally Important. 

Using the null hypothesis, that all four attributes were considered to 
be of equal Importance, led to a rejection by the Ch1-square test. 
"Classroom organization and approach" wasconsidered to be the most 
Important and "knowledge of government" the least Important. 

Deleting the highest ranked attribute almost reduces the remaining 
items to a common level at which one could assert that the three 
remaining are equivalent. This the resultant Ch1-squ"are statistic to 
7.44, a value greater than the critical value of 5.991 at the 5% confidence 
level, again resulting in a rejection of equivalence. (The original 
Gh1-square value was 24.86 with a critical value of 7.815). 

If one were to further delete "exemplary behavior" from the analysis, 
the remaining elements could be shown to be equivalent. This leads to the 
tentative conclusion that the two highest ranking elements are indeed 
critical to the teaching of citizenship. 
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Teocher Attributes for Effective Instruction in Citizenship 
1905 - 06 Survey 



ES553 



so 



30 



20 - 



10 







Frequency of Uooblo Rooponoot 
OvmSm 0 



What is the most important teacher attribute 
for effective instruction in citizenship 
educa t i on? 

(please select one) 

knowledge of government 

exemp lary behavior 

concern- for students 

classroom' organization and 
approach 
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THE ANALYSIS OF QUESTION *10 



Question: What role(s) should indoctrination play in citizenship 
education? (please select one) 

none 

to teach American values 
to teach patriotic Ideals 
to teach national history 

to socialize the child Into the American way of life 
to achieve some degree of national unity 

This is a poorly stated question in that the original statement asks 
for a plural response, but thenthe request is specifically for Just one. 
Most respondents indicated only a single choice. 

Hypothesis: "Indoctrination" should play an equivalent role in each of the 
listed teaching modes of teaching citizenship. 

Apparently the work "Indoctrination" is a "loaded" word, as 48 of the 
91 usable responses said It should have no role. This extreme bias 
resulted in a rejection of the null hypothesis that indoctrination should 
play some role in citizenship education. On combining "patriotism" and 
"history" as a single entry, the increasedfrequency count assures a more 
reasonable set of data. The Chi -square test resulted In a calculated 
value or 56.7, far in excess of the critical value at the 5% level of 
significance of 9.488. 

If the "none" category Is deleted from, the analysis and again "history" 
and "patriotism" are combined, a Chi -square value of 12.75 is obtained. 
This Issttll in excess of the 5% level critical value of 7.815, and hence 
the null hypothesis of equal responses Is rejected. 
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Rok of Indoctrinotlon in Citizenship Educotion 
t«85 - 86 Survty 




Frtqutncy of Ut obit Rt spent m 




at role(s) should indoctrination 
ay in citizenship education? 

(p.lea'se se.lect one) 

none 

to teach basic American values 

to teach patriotic ideals 

to teach national history 

to socialize the child into the 
Amer i can way of life 

to achieve some degree of 
na t i ona I unity 




THE ANALYSIS OF QUESTION *1 1 



Question: What are the 3 most important measures of an effective 
citizen? (please rank order) 

knowledge of current issues 
participation In school activities 
dependability in school tasks 
concern for the welfare of others 
moral and ethical behavior 
acceptance of authority of school officials 
ability to question and challenge ideas 
ability to make wise decisions 

Hypothesis: All measures of an effective citizen are of equivalent 
importance. 

Testing the assumption that all values are equally important was 
again carried out with the Chi-square statistic. Using all eight 
categories gave a test value of 67.3 well in excess of the critical value of 
14.067. 

On observing that noone ranked "acceptance of authority" among the 
first three, this item was deleted from the analysis providing for a 
Chi-square calculation of 23.9. From observation of the graph, it 
appears that the items fall in different categories, with "participation " 
"responsibility," "ethics" and "skill" being among the higher ranked. 

The lower section of the stacked bars in the graph indicates the 
frequency of those ranking first. !t is evident that "ethics" significantly 
ranked above all other items. 
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Important Measures of an Effective Citizen 
1965 - 66 Survty 




Top Throo Rank Froquoneto of Foe tor* 
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What are the 3 most important measures 
of an effective citizen? 

(please rank order) 

. knowledge of current issues 
participation in community affairs 
acceptance of responsibilities 
concern for the welfare of others 
moral and ethical behavior 
acceptance of authority 
abi I i ty to quest ion i deas 
skill in prob I em solving 
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THE ANALYSIS OF QUESTION *\2 



Question: What Is the single most Important citizenship attribute of young 
adults? (please select one) 

Hypothesis: There Is no single most important citizenship attribute for 
young adults. 

The data divides into two distinct groups, with three of them 
receiving the greatest frequency of responses. Considering only these hioh 
ranking values, a Chl-square value of 4.2 was calculated, less than the 
critical value of 5.991. It can thus be assumed that each of the three 
items — "ethics," "questioning" and "decision-making" — was equal lv 
important. 
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Important Citizenship Attribute of the Young Adult 
1985 - 86 Survey 
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What is the single most important 
citizenship attribute of young adults 9 

(p.i ease select one) 

knowledge of government 
participation in school 

act i v i t i es 
dependability in school tasks 
moral and ethical behavior 
acceptance of the authority of 

school officials 
ability to question and 

challenge ideas 
ability to make wise decisions 
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WORKING DEFINITIONS 

The following working definitions were Included In the questionnaire In 
order to help clarify the eight citizenship approaches. Questions 13-23 
required respondents to apply these eight citizenship approaches to 
instructional situations. 
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THE EIGHT APPROACHES TO 

CITIZENSHIP EDUCATION 



Citizenship as: 

Persuasion, Socialization, and Indoctrination 

This approach is based on the assumption that children 
need to be taught the perceived norms and values of 
their society and culture. 



Contemporary Issues and Current Events 

This approach is based on the assumption that in order 
to become effect ive and concerned citizens, studer. 4 
must participate in studying the contemporary issues 
of their times. 



Study of American History, Civics, Geography and 
Related Social Sciences 

The underlying assumption of the approach is that students 
will become "good citizens" through the accumulation of 
factual information pertaining to the setting, history, 
process of government, and the American economic system. 



Civic Participation and Civic Action 

This approach is based on the assumption tha r "good 
citizens" are capable of participating directly in the 
affairs of adult society. 

Page 1 of 2 
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THE EIGHT APPROACHES TO 

CITIZENSHIP EDUCATION 



Citizenship as: 
[Scientific Thinking 

fenf b .?L C " nd# r ,y , ,B8 assur "Ption of this approach is 

2^..1*a„V 0 h ™J d H b ' trained in ° ertain '"f ILctui? 
th^. DO n.lh?r?f ? < 'n order to help them assume 
[the responsibilities of effective citizenship. 

(Jurisprudence (legalistic) process 

te«M* P f°- aCh / S b ? S .* d ° n the assum P*ion that traditional 
lees's f^/^? ," d ' e ? ali . sti o Processes hold the key o 
jsi.cessful citizenship in a democratic society. 

Humanistic Development (concerns for the total 
welfare of the student) 

This approach is based on the assumption that citizen- 

ta'nl UCa V° n , r f Sts 0n the ^owth and development 6f 
healthy and well-adjusted children. 

Preparation for Global Interdependence 

Iatfon a a P r,v° aCh / ef i eCtS the growin 9 ooncerns about 
nationally centered programs that tend to nealect the 

suk*'* needs ' iinks - and rwVorrftS: 
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THE ANALYSIS OF QUESTION *13 

Question: Are you familiar with all eight approaches? Yes, No If not, 
please designate the approaches you are less familiar with. 

Analysts: Eighty-eight indicated that they were familiar with the eight 
approaches, thirteen were not, and two did not respond. Ignoring the no 
responses, this reference gave a 87.1% yes response. 

To provide for sampling variability, a confidence Interval 
estimate was made, indicating that at the 95% confidence level, one can 
assert that the true percentage of yes responses should lie in the interval 
from 80.6% - 93.6%. 
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Least Familiar Approach to Citizenship Education 
1985 - 66 Survey 

•r— 




J Approach to Teaching Cittzonshtp 

I 

Are you familiar with al! eight approaches? 
If not, please designate the approaches you 
are least f ami liar wi th. 

Persuasion, Socialization, and Indoctrination 
Contemporary Issues and Current Events 

Study of American History, Civics, Geography 
and Related Social Sciences 

Civic Participation and Civic Action 

Scientific Thinking 

Jurisprudence (legalistic) Process 

Humanistic Development (concerns for the total 
welfare of the student) 

Preparation for Global Interdependence 



57 



THE ANALYSIS OF QUESTION * 1 4 

Question: Designate the approaches that are Included in your instructional 
program. 

Though 87.18 claimed familiarity with all eight approaches, the 
response to this question shows that all approaches are not equally used 
(or accepted) in instructional programs. Allowing for multiple strategies 
to be used, the sum of the responses exceeds the number of individuals 
answering the questionnaire. At this point no effort has been made to 
determine whether a pattern of mixed strategies of instruction is to be 
found, it can be demonstrated, however, that all methods are not in equai 
favor. 

Hypothesis: All of the eight approaches are equally used in citizenship 
instructional programs. 

A Chi -square analysts was performed to determine statistically if 
the approaches are equally ^sed. The following data on approaches used 
gave rise to a calculated Chi-square statistic of 17.481 at seven 
degrees of freedom. At the 5% level the critical value Is 14.067, and hence 
the hypothesis of uniform usage is rejected. .From looking at the 
histogram it is apparent that "persuasion" is the least used. 

persuasion 36 issues 68 

history 65. participation 65 

scientific 61 jurisprudence 47 

humanistic 46 global 65 

Essentially, five of these approaches are used with equal frequency, 
but even these are used in less than two-thirds of the programs. 
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Approaches Employed in Instructional Programs 
1965 - 86 Survty 




Approach to Ttachina. Citizenship 



Designate the approaches that are 
included in your instructional program. 

Persuasion, Socialization, and Indoctrination 
Contemporary Issues and Current Events 

Study of American History, Civics, Geography 
and Related Social Sciences 

Civic Participation and Civic Action 

Scientific Thinking 

Jurisprudence (legalistic) Process 

Humanistic Development (concerns for the total 
welfare of the student) 

Preparation for Global Interdependence 
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THE ANALYSIS OF QUESTION *I5 



Question: Rank-order the eight approaches according to your preferences. 

Hypothesis: There is no preferred ranking of the eight citizenship 
approaches. 

•In this and the next two questions, two methods of statistical 
analysis were employed. The first was to combine the ranks Into 
groups of two, that J and 2, 3 and 4, 5 and 6, 7 and 8 and use 
composite ranks to determine whether or not the distribution of ranks was 
uniform for any of the approaches. This grouping was done to assure that 
each cell had a sufficiently high frequency of responses to facilitate a 
valid statistical computation, and to help minimize the problem of 
absolute differences between adjacent ranks. Only the case of 
"humanistic" approach held up for uniformity of ranks at the 5% level. 
On going to the \% level, the "global" approach also could be asserted to 
have uniformly distributed rankings. 

These results suggest the remaining six approaches do have ranking 
structure. To further analyze this question, a modification of the 
nonparametrf c test developed by Page for ordered alternatives 
was used. 

In performing the analysis, a weighted rank of the eight elements was 
calculated. The calculated weighted rank-orders, relative to instructional 
approaches, are as follows: ' 

persuasion 2.1 issues 5.6 

history 4.5 participation 5.8 

scientific 5.2 Jurisprudence 3.8 

humanistic 4.0 global 5.) 

"Persuasion" has the lowest rank of all approaches. At the other extreme, 
"participation" and "Issues" rank highest, though a statistical difference 
cannot be established by the analysis performed that there is any 
statistical difference in ranking between these two. The ordering of the 
remaining five approaches lies between^these two extremes, but other 
analysis methods will need to be developed to determine if the variations 
in ranking between them is significant. 
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The overall analysis yielded a value of 1454.7 for the test statistic, 
well in excess of the 5% critical level value of 1371. This allows us to 
conclude that there is evidence of strict inequalities in the calculated 
rankings. Beyond the three groupings indicated, little can be conjectured 
with confidence. 



61 

53 



Ranking of Instructional Approaches 
1985 - 86 Survty 




Approach to T«och?ng CItfz«n«h!p 
OvmKm 18 



Rank order the eight approaches 
according to your preference. 

Persuasion, Socialization, and Indoctrination 
Contemporary Issues and Current Events 

Study of American History, Civics, Geography 
and Related Social Sciences 

Civic Participction and Civic Action 

Scientific Thinking 

Jurisprudence (legalistic) Process 

Humanistic Development (concerns for the total 
welfare of the student) • 

Preparation for Global Interdependence 
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THE ANALYSIS OF QUESTION *I6 



ERIC 



Question: Rank-order the eight approaches according to the perceived need 
of American society. 

Hypothesis: There is no rank-orderings among the perceived. needs of 
American society. 

In ranking the perceived need of society, ttvwof the approaches were 
given no clear-cut ranking at the 5% level of significance by a Chl-square 
test. These approaches include "issues," "humanistic," and "global" at the 
5% level, and, at the \% level, "scientific thinking" also could be included. 

Employing the modification of the nonparametrlc procedure 
developed by Page used with the preceding question, we could determine 
whether or nor there is a strict ordering between elements. The following 
weighted rankings were obtained: 

persuasion 3.2 issues 5,2 

history 4.7 participation 5.7 

scientific 5.0 jurisprudence 4.0 

humanistic 3.8 global 4.4 

The Page statistic calculated to 1405.2, again significant at the 5% 
level, supporting the argument that there is a perceived ranking relative to 
the perceived need of society. The logical separations, according to the 
data, are "persuasion" at the low end and "scientific thinking" at the high 
end. 
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Ranking of Percefved N*«d of Society 
1985 - $6 Survty 



1 * X 



3*4 



9*9 



Htfilw 
7*1 




HWwy P«tf** Stfwtfff, 

Approod> to Uochfaq Citfztnihip 
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Rank order the eight approaches 
according to the perceived need of 
American society. 

Pel-suasion, Socialization, and Indoctrination 
Contemporary Issues and Current Events 

Study of American History, Civics, Geography 
and Related Social Sciences 

Civic Participation and Civic Action 

Scientific Thinking 

Jurisprudence (legalistic) Process 

Humanistic Development (concerns for the total 
wel fare of the student) 

Preparation for Global Interdependence 
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THE ANALYSIS OF QUESTION *17 



Question: Rank-order the eight approaches according to student 
preferences. 

Hypothesis: There is no rank-ordering of the eight approaches according 
to perceived student preferences. 

This question is similar to the precedingtwo, but, addresses 
perceived student^preferences. In this analysis, "history" and "humanistic" 
approaches registered no difference at the 5% level in the assigned 
rankings; thus, there was no unanimity of opinion among the respondents 
for these two items. 

In using the modified Page approach, the data barely supports, at 
the 5% level, a rank -ordering between the approaches exists. The 
calculated statistic had a value of 1373, two points more than the critical 
value. One can assert that there is some ranking for this issue among the 
approaches. The weighted ranks calculated are as follows: 

persuasion 4.0 issues 4.7 

history 4.8 participation 5.5 

scientific 3.8 Jurisprudence 42 

humanistic 5.1 global 3.5 

The range of ranks in this problem is smaller than in the preceding two 
questions. The most obvious stand-out is "participation" with the highest 
ranking, with "humanistic" not being even a close second. At the other 
extreme, the respondents felt that students had little interest in "global" 
concerns. 
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Ranking of Perceived Student Preferences 
1985 - 86 Survey 

1 ** * >»• 7*1 
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Approach to Teaching Ctthtonahfp 

OwmOm 17 



0 

Rank order the eight approaches, 
according to student preferences. 

Persuasion, Socialization, and indoctrination 
Contemporary issues and Current Events 

Study of American History, Civics, Geography 
and Related Social Sciences 

Civic Participation and Civic Action 

Scient i f ic Thinking 

Jurisprudence (legalistic) Process 

Humanistic Development (concerns for the total 
wel f are of the student) 

Preparation for Global Interdependence 
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THE ANALYSIS OF QUESTION *I8 



Question: Which of the eight approaches^ most commonly described in 
your methods textbook? 

Hypothesis: All eight citizenship approaches are equally described in 
social studies methods textbooks. 

A statistical analysis of the approachas to see If each Is given more 
or less an equivalent treatment in the textbooks results in a rejection of 
the hypothesis. The calculated Chi-square statistic has a value of 5? 6 
well in excess of the critical value of 12.592. 

Because three of the intervals have fewer than five responses, the 
actual Chl-square computations are suspect, but the data as graphed 
Illustrates that the most used approaches are the "scientific" and 
"historical" approaches. 
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Approoches Described fn Methods Textbook 
1985 - 8$ Survoy 




Approoch to Toochfog Cftfzonohfp 
Outfit** 10 



Which of the eight approaches is most 
commonly described in your methods 
textbook? 

Persuasion, Socialization, and Indoctrination 
Contemporary issues and Current Events 

Study of American History, Civics, Geography 
and Related Social Sciences 

Civic Participation and C.vic Action 

Scient if ic Thinking 

Jurispruc'^-v (legalistic) Process 

Humanistic b , . * I opmen t (concerns for the to'-al 
welfare of the student) 

Preparation for Glpbul Interdependence 
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THE ANALYSIS OF QUESTION *!9 



Question: If these eight approaches were included in a separate 
citizenship course, which approach(es) would serve as the "core" of the 
course? 

Hypothesis: Any of the eight approaches could equally serve as the "core" 
for a _separate=citizenship course. 

Testing the null hypothesis that all approaches have an equal 
likelihood of being selected leads to a rejection. The Cht-square 
statistic has a calculated value of 36.4 which grossly exceeds the 
critical value of 14067 for sevemdegrees of freedom. 

Even with the option of multiple responses being it is noteworthy to 
recognize that "persuasion" is generally considered to be an unacceptable 
strategy for teaching citizenship. 

At the other extreme, approximately half of the respondents indicated 
that "participation" should be used. Again no analysis of composite 
P'.tterns has been ri.ade. 
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Recommended Core Approoches to ^Cffizenship Course 
190S - 86 Survey 




Approach to Teaching Cfta«njhtp 
Q*m*m it 



* - : r 

If these eight approaches were included 
in a separate citizenship course, which 
approach(es) should serve as the "core". 

Persuasion, Socialization, and Indoctrination 
Contemporary Issues and Current Events 

Study of American History, Civics, Geography- 
and Related Social Sciences 

Civic Participation and Civic Action 

Scient if ic Thinking 

Jurisprudence (legalistic) Process 

Humanistic Development (concerns for the total 
welfare of the student) 

Preparation for Global interdependence 
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THE ANALYSIS OF QUESTION *20 



Question: If these eight approaches were included in a separate 
citizenship course, which approach(es) should be eliminated from the 
course? 

Hypothesis: None of the eight approaches should be eliminated from a 
separate citizenship education course. (In a sense this question is similar 
to Question* 1 9.) 

From the data, it is evident that over 508 of the respondents felt that 
"persuasion" should be eliminated as an approach for teaching citizenship. 
The next highest ranking was "humanistic" which received one third the 
votes given for the elimination of "persuasion." (It should be noted that no 
one voted for the elimination of "participation"). 

In pursuing this question, one could ask how the issue or approach of 
"persuasion" is interpreted. It appears to be a "loaded" word. 

A valid Chi -square V3lue is not likely due to the low frequencies 
given to several-of the items: Ignoring this problem, a Cht-square value 
of 1640 was calculated, a value an order of magnitude greater than the 
critical value. One can conclude, as supported by the graph, that strong 
opinions exist as to which approaches should be retained. 
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Recommended for Elimination from Citizenship Course 
1985 - 86 Survey 




If these eight approaches were included 
in a separate citizenship course, which 
approach(es) should be eliminated? 

Persuasion, Socialization, and Indoctrination 
Contemporary Issues and Current Events 

Study of American History, Civics, Geography 
and Related Social Sciences 

Civic Participation and Civic Action 

Sci nt if ic Thinking 

Jurisprudence (legalistic) Process 

Humanistic Development (concerns for the total 
welfare of the student) 

Preparation for Global Interdependence 
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THE ANALYSIS OF QUESTION *21 

Question: If these eight approaches were included in a separate 
citizenship course, which approach(es) should be the dominant approach of 
the elementary school? 

Hypothesis: None of the citizenship approaches should be dominant in a 
separate citizenship course. 

A Chi-square analysis of the hypothesis of equal selection gave a 
statistic value of 37.0, leading to the rejection of equal selection. 

Ranking the approaches gives the following listing in order from the 
most preferred to the least preferred: 

participation 

humanistic 

history 

global 

Issues 

scientific 

persuasion 

jurisprudence 

It Is interesting to note that the "jurisprudence" approach ranks lower 
than "persuasion." Comparing the responses to question *20, this would 
not be expected, even .'iough this question specifically addresses the 
elementary school. 
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R«comm«nd«d Oominont Approaches for Elementary School 
1985 - 86 Sumy 




Approach to Tcachfog Citizenship 

WWM 21 

If these eight approaches were included 
in a separate citizenship course, which 
approach (es) should be the dominant 
approach in the elementary school? 

Persuasion, Socialization, and Indoctrination 

Contemporary Issues and Current Events 

Study of American History, Civics, Geography 
and Related Social Sciences 

Civic Participation and Civic Action 

Scient i* tc Thinking 

Jurisprudence (legalistic) Process 

Humanistic Development (concerns for the total 
welfare of the student) 

Preparation for Global Interdependence 
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THE ANALYSIS OF QUESTION *22 



Question- if these eight approaches were included in a separate 
citizenship course, which approach(es) should be (the) dominant 
approach(es) of the junior high school? 

Hypothesis: None of eight citizenship approaches should dominate a 
separate citizenship course for the junior high school. 

There is a shift in pattern from that of the etementary school; 
however, the calculated C.ii-square value for the hypothesis of equal 
responses or selection is 45.9. This again leads^to a rejection. 

In this case, "participation," "issues" and "history" lead the list with 
similar scores. At the other end, "persuasion" is now the lowest ranking 
with "jurisprudence" as an approach being second to the last, but doing 
considerably better than "persuasion." 
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Recommended Dominant Approoches for Junior High 
1965 - 86 Survty 




Approach to Teaching Citfc , .Mp 

Owttk 22 

If these eight approaches were included 
in a separate citizenship course, which 
approach(es) should be the dominant 
approach of the junior high school? 

• Persuasion, Socialization, and indoctrination 

Contemporary Issues and Current Events 

Study of American History, Civics, Geography 
and Related Social Sciences 

Civic Participation and Civic Action 

Scientific Thinking 

Jurisprudence (legalistic) Process 

Humanistic Development (concerns for the total 
welfare of the student) 

Preparation for Global Interdependence 
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THE ANALYSIS OF QUESTION *23 

Question: If these eight approaches-were Included in a separate 
citizenship course, which approach(es) should be the dominant 
approach(es) of the senior high school? 

Hypothesis: None of the eight approaches should dominate a separate 
citizenship course for the senior high school. 

This question Is the same as the preceding two, but this time 
addressed to the senior high school, "persuasion" Is all but eliminated 
from consideration by the respondents. The "humanistic" approach now 
ranks second from the bottom with "jurisprudence" slightly above It. 

The high ranking approaches are again "participation," "Issues" and 
"history" as with the junior high school. Closely behind these follow the 
"scientific" and "global" approaches. 

Using the Chl-square to determine whether these approaches were 
equally selected gave a value of 76.3* resulting In a rejection of the 
hypothesis. 
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Recommended Dominant Approaches for Senior High 
1965 - 66 Survey 
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Approach to Teaching Citizenship 
QwUin 23 



If these eight approaches were included 
in a separate citizenship course, which 
approach(es) should be the dominant 
approach of the senior high school? 

Persuasion, Socialization, and Indoctrination 

Contemporary Issues and Current Events 

Study of American History, Civics, Geography 
and Related Social Sciences 

Civic Participation and Civic Action 

Scient if ic Thinking 

Jurisprudence (legalistic) Process 

Humanistic Development (concerns for the total 
welfare of the student) 

Preparation for Global Interdependence 
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Elementary 
School 
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Recommended Approaches for Teaching Citizenship 

1985 - n .6 Survey 

- Junior 

High 



Senior 
High 



Persuasion 




Issues 



History 



Scientific 



Porticip. 

Approach to Teaching Citizenship 
Composite of questions 21. 22 and 23 



Juris 



Humonistic 



Global 



THE ANALYSIS OF QUESTION *24 

Question: Do you accept the following definition of citizenship education, 
or how would you modify 1t to meet your conception of the term? 

Analysts: 69.893 accepted the statement. On the basis of this value and 
the sample size; It can be asserted with a 95% confidence level that the 
true percentage^ the population accepting the statement lies in the 
Interval 60.6% ^ 79.0%. 



79 - ft 
72 



Question 24 



Do you accept the following definition 
of citizenship education or how would 
you modify it to meet your conception 
of the term? 

"While an important and central element of the 
social studies, citizenship education is a 
responsibility of the entire school (as well as 
of family and community). It includes the means 
by which individuals are prepared to gain the 
knowledge, skills, and values that enable them to 
understand, examine, decide, and participate in 
public affairs and in forwarding the well-being 
of other individuals and of their society." 



This statement was accepted by 69.8% 
of those responding. It can be asserted 
with 95% confidence that the true response 
lies within the interval: 60.6 -79.0% 
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IV. SOCIAL INF-*'*' " *•■* ON CITIZENSHIP AND 
C3 'EDUCATION 

Citizenship values jahd/'ashayibrs often are considered derivatives or 
an individual's society,|narcujture. Values and behaviors are considered a 
product of our experierie^> ; Including our social relationships and 
education. Social relationships tend to include those people who are 
responsible for nurturJiig,Awh11e education Is seen afc the responsibility of 
the community at large^hcludi.ig the schools. In order to explore the 
Influences of social relationships and education on the citizenship 
development of the child, a pool of questions that addressed the following 
concerns was developed: 

1. The perceived sources of citizenship Influence for 
values, knowledge, and skills at both the elementary 
and secondary levels of experience 

(questions 3, 4& 5) 

2. The perceived Influences of social factors on Instruction 
(question *6) 

3. The perceived Inf luence of education on citizenship 
(question * 8) 

4. The educator's perception of the 'good citizen' 
(questions *l I & 12) 

5. The educator's perception of the perceived needs 
of American society (question * 1 6) 

Item: 

Question *3: 

Which of the following is most Influential in the formation of citizenship 
values? (please select one: parents, teachers, friends, siblings, religion 
leaders, others) 

Survey Result: 

(see chart on Question * 3) 

Inferences: 8l 
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Elementary Students. 

It may be Inferred from the respondents' results that: 

1. Elementary students' citizenship values are affected mainly by parental 
Influences when compared with other. sources of Influence. 

2; While teachers have some Influence on the elementary citizenship 
values^ this Inf luence is.minor When compared to that of parents. 

3. Friends, siblings, religious leaders./and others are considered 
inconsequential in developing citizenship values. 

Secondary Student 

j .. Secondary students' citizenship values are affected mainly by peer 
influences when compared tq/other sources of influence. 

2. While parents continue to be an impc ant source of citizenship values 
for secondary students. t t'<e parental inf luence ceases to be the primary 
source. 

3. Treacher's influence affecting citizenship values is considered much 
stronger in secondary schools than in elementary schools, but when 
compared with peer influences, the teacher's influence is relatively weak. 

4 Siblings, religious leaders, and others are considered insignificant in 
developing citizenship values. 

Item: 

Question** 

Which of the, following is most influential in the formation of citizenship 
knowledge? (please select one:.parents, teachers, friends, siblings, 
religous leaders,, others) 

Survey Result: 

(see chart on Question * 4) 

Inferences: 

Elementary RtnrlPntc; 

It may be Interred from the respondents' results that: 

1. Elementary students' citizenship knowledges acquired mainly from 
teachers. 
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2. While.parents have influence or 'he elementary students' acquisition of 
citizenship knowledge, this Influence Is significantly Smaller than that of 
elementary teachers. 



3. Friends, siblings, religious leaders and others are considered 
inconsequential as sources of citizenship Knowledge for elementary 
students. 



Secondary Students 

I. Secondary students' citizenship knowledge Is acquired mainly from 
teachers. 



2. Parents, friends,., and others are considered of only minor importance in 
the acquisition of citizenship knowledge. 

3. Siblings and religious leaders are considered of no consequence to the 
acquisition of citizenship knowledge. 

4. It is. interesting to note that in the opinion ofrespondents, secondary 
Students do not look to their peers tor citizenship knowledge. 

Item: 

Question #5: 

Which of the following is most influential in the learning and practice of 
citizenship skills? t please select one: parents, teachers, friends siblings, 
religious leaders, other?) 



(See chart on Question * 5) 

Inferences: 

Elementary Students 

1. Eietetary students' citizenship skills are acquired mainly from 
parents and teachers. 

2. teachers. are considered only slightly more Influential than parents as a ' \ 
sources of skill development. j 

3. friends, siblings, religious leaders, and others are considered 

inconsequential sources of citizenship skills. '-'.> 



Survey Result: 



Secondary Students 

1. Secondary students' citizenship skills are acquired mainly from 
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teachers. 



2. Friends or peers are now considered important sources of citizenship 
skills. 

3. "Parents continue to contribute to the secondary students' skill 
development, but parental influences are less significant thart ft-iends' and 
especiall,\teachtrs' influences. 

4 Siblings,; religious leaders, and others are considered of little or no 
consequence to the acquisition of citizenship skills. 

5. in the opinionof respondents, the.sources of secondary citizenship 
skills tend to shift away from parents and toward friends or peers, while 
the teachers' influence tends to be maintained throughout both elementary 
and secondary grades. 

Item: 

Guestion*6 

Do citizenship instruuJohal programs vary according to the following 
attributes^ students: race, religion, ethnic affiliation, political 
background, economic background, social background, student ability, 
student experience, community characteristics? 

List other specif ^factors that might influence program differences in 
addition to those listed above. 

Survey Result: 

82.2%.responded yes. 

The, respondents indicated .that citizenship programs vary according to 
student attributes. Using a large sample estimate of the Clopper-Pearson 
confidence interval, the expected true value can be,assumed to tie in the 
interval 12.2%- 88.2% at the 95% level of confidence. 

Respondents' list of other factors: 
Student Attributes: 
Academic ability 
Gender 
Interests, 
Learning styles 
Handicaps 
Prior knowledge 

11 



Developmental level 
Youth group membership 
Friends 
Siblings 

Parental attitudes and values 
Parental level of education 

Teacher Attributes 
Background 

Professional affiliation 

Responsibilities 

Perception of citizenship 

Knowledge 

Skilis 

Ability to teach 
Religion 

Personal qualities 
Political perspective 
Attitudes and values 
Motivation 

Commitment to citlzenshfp development 

Community Attributes 

Predominant values and attitudes 
Region of nation 
Social expectancies 
Dualities of "leadership 
Spcip-econbmic-standards 
Interests 

Financial support for education 
Media and communication influences 

Program Attributes 

cNature of the instructionalprogram 
Level of indoctrination 
Nature of the school curriculum 
Nature of instructional materials 

Item: 

Question,*^ 

Whet cloyou estimate the overall percentile influence of education on the 
development of cuizt'nship to be in.Amer-ican society? Cplease select one- 
908, 708,50%, 30%; 10?)? 



Survey Result: 

(see chart.on Question * 8) 



The mean percentagr or influence of education on the development of 
citizenship as determined by the respondent's assessments was 37.2% 
with a standard deviation of 15.98. the median value was 35.6%, and the 
first and third quartile points were 25.6% and 48,7%. 

Inferences: 

. Education has had only a moderate inf luence^on the development of 
citizenship in American society. 



Item: 

Question *1 1 

What arethe three most important measures of an elective citizen? 
(please rank order knowledge of current issues, participation in 
community affairs, acceptance of responsibilities, concern for the welfare 
of others, moral and ethical.behavior, acccptanc^of authority, ability to 
question ideas, skill in problem .solving) 

Survey Result: 

(see char^dn Ques.tion •* U) 

Inferences: 

1. "Moral and ethical behavior- WdS considered a very important measure 
of an effective citizen. . 

2. "Acceptance of responsibility" and "skill in problem-solving" also were 
considered important as a measure of an effective citizen. 

3. "Participation jh community affairs" and "ability to question ideas" 
were given moderate Importance as measures of ah effective citizen. 

4 "Knowledge of current issues" and "concern for the welfare of others" 
were given less importance than most of the other measures selected by 
respondents., 

5. "Acceptance, of authority" was not givenany importance as a.measure of 
,an effective .citizen. 



Item: 

Question*! 2 

What is the single most important citizenship attribute of young adults'? 
(please select onenknowledge of government, participation in school 
activities, dependability in,school tasks, moral and ethical behavior 
acceptance of the authority of school officials, ability to nuest.bn and 
challenge ideas, ability to make wise decisions) 

Survey Result: 

(see chart on Question *!2) 

Inferences: 

1. The "ability to make wise derisions" is considered statistically the 
most Important citizenship attribute of the young adult citizen. 

2. "Moral and ethical behavior" Is the second most Important attribute 
followed by the "ability to question and challenge Ideas." 

3. "Knowledge of government," "dependability in school tasks," and 
"acceptance Of the authority of school off Icials" were not considered 
Important as citizenship attributes of young adults.. 

Item: 

Question* 16: 

Rank.prder the eight approaches^accordlng to the perceived needs of 
Amer-i an society. 

Survey Result: 

(see chart oh Question * 16) 

Inferences: 

L "ClvlCipartlclpatJon and civic action" Is the pre.erred citizenship 
approach) for the perceived needs of American society. 

2. "Contemporary issues and current events" is the second preferred 
citizenship approach for theperceived needs of American society. 

3. '"Scientific thinking* is the third preferred citizenship approach for the 
perceived needs of American society. 
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4 "Study of American history, civics, geogr?chy andrelated social 
sciences" is the fourth preferred citizenship approach-f or the perceived 
needs of American society.. 

5. "Preparation for global interdependence" is the fifth preferred 
citizenship approach for the. perceived needs of American society. 

6. "Jurisprudence process" is the sixth preferred citizenship approach for 
the perceived needs of American society. 

7. "Humanistic development" is the seventh preferred citizenship approach 
for the perceived needs of American society. 

'& "Persuasion, socialization, and, indoctrination" is the least selectedof 
the citizenship approaches for the perceived needs of American society. 

DISCUSSION: 

1. The perceived sources of citizenship influence for 
values, knowledge and skills at both the elementary 
and: secondary levels of experience (questions 3, 4 & 5) 

In the opfniori.of the respondents; the most significant sources 
of citizenship value influences are parents in the elementary school 
and friends or peers in the secondary school. There is a marked shift 
away from parents toward peers as the studentadvances through the, 
grade levels, while the teacher evidentiyhas little influence-on the 
citizenship values of either elementary or secondary students. 

While the survey did headdress the types of 
knowledge-acquired by elementary and secondary students, It is 
obvious that the respondents-considered teachers as the single most 
Important sourceof both elementary and secondary citizenship 
knowledge. The teachers' inf luence tends to increase as students 
advance through the grade levels and as.they mature intoyoung adults. 

While the survey did not address the types or kinds of 
citizenship skills acquired by either elementary or secondary 
students, it is interesting to note thast the teacher was a 
constant source of inf luence for ci ti zenshlp sikl lis. 

2. The perceived influences of social factors on 
instruction (question *6) 
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Tha respondents indicated that citizenship programs vary 
according to student attrubutes. As noted earlier, the expected true 
value can be assumed to lie in the interval 72.295 - 88.2% at the 95% 
level of confidence. 

3. The perceived Influence of education on citizenship 
(question * 8) 

.While the actual influence of education on the development of 
citizenship remains an unknown,quantity,4here was a general 
consensus among.respondents Mat the estimated influence was 
considerable when,ohe attempts to take into accountall of the 
factors that influence citizenship development. (Se? item *6 for a 
listing of some of these /actors.) Whether or not the respondents 
consider this result as a relatively high or low level of influence was 
not determined. This result raises a question; assuming that 
educationdoes play a significant role In the development of 
citizenship, "Should We as educators influence students to strive to 
achieve a'higher and nobler vision of citize nship and could this vision 
of citizenship be trahformed into social behavior and social action?" 

4. The educators' perception of the "good citizen" 
(questions*! I & 12) 

As a f irst choice, "moral and ethical behavior" was selected as 
the most important measure of an effective citizen. "Acceptance of 
responsibility" and "skill in problem-solving" were Considered of 
equal importance to "moral and ethical behavior," with "participation, 
in community affairs" followed close behind. 

The most surprising result was thef ej -ction of "acceptance of 
authority:" This rejection raises some very interesting perception 
questions regarding the role of the citizen in American society such 
as, "What is the relationship between the citizen and those In 
positions of authority?" and "How should citizenship education 
content address.the relationsn?p$etween the citizen an&the 
authority of the state?" 

The question was stated so that the respondents .would select 
the factors:that would "measure" ah effective citizen. The 
respondents avoidance of "acceptance of authority" led these 
researchers to speculate as to Whether or not respondents believe 
that the person who accepts authority is a person with 
questionable democratic traits. In light of this possibility, these 
researchers also would.argue that "acceptance of authority" is 
fundamental to the stability of any society and, to some extent, is a 
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requirement of the formation of the state. Why then was "acceptance 
of authority" rejected by respondents as a measure of ah effective, 
citizen? Perhaps it was due to the words of the phrases like 
"indoctrination," and "acceptance of authority." These words and 
phrases may simply be unpopular with these educators. 

The strong consensus among respondents for three citizenship 
attributes of young adults leads^to some Interesting speculations 
about the percejved nature of "good" citizenship. The three most 
popular choices.reflect sophlsticated.ihtellectual an&moral qualities 
pertaining to citizenship, it can.beargued thatthese sophisticated 
intellectual and moral qualities go beyond content knowledge, meeting 
daily responsibility, and obedience to the rules of social behavior, and 
reach into the domain of wise, prudent, capable, and. judicious 
citizenship, the type of "good" citizenship that is compatible with a 
higher order of social existence or the type of citizenship that 
philosophers and scholars have prescribed over the ages., By selecting 
these attributes,, the respondents have no\^automattcaliy. rejected the 
more mundane attributes associated With "knowledge of government," 
etc. On the contrary, they mav^have placed citizenship on a higher 
ideological plane that would undoubtedly encompass the more ordinary 
requirements of citizenship, including the four attributes that were 
not generally selected. 

5. The educators' perception of ihl perceived needs 
of American society, (question * 16) 

The respondents continued to supporf;"civic participation and 
civic action," "contemporary issues.and current events," and 
"scientific thinking" as the citizenship approaches of ipice in regard 
to the perceived n^eds of American society. There w /e some slight- 
changes in rank order for the preferences of "study of American 
history, c\ :.\c% geography and the related social sciences," 
"preparation for global interdependence," jurisprudence process" and 
"humanistic development" from those found in question * 1 5. 
"Persuasion, socialization and indoctrination", remained the least 
preferred citizenship approach in lirht of the perceived needs of 
American society. 
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CURRICULUM ISSUES AND INFLUENCES 
RELATED TO CITIZENSHIP EDUCATION 



The role and function of citizenship education within the social 
studies curriculum has been debated In regard to Its grade level placement 
and In regard to whether or not It should b§ taught as an integrated or 
separate social studies program. In addition, educators are becoming 
aware of the developmental aspects of Instfuctton, especla lly in regard to 
the development of values and attitudes. Because citizenship education is 
directly associated with values* as well as knowledge and skills, Its 
placement and function In regard to the curriculum are an Important 
Issues. In order to explore Uie functional relationships between 
citizenship education and the social studies curriculum, the following pool 
of questions was developed to address the following concerns: 

1; The appropriate age to begin citizenship education 
Instruction (question*!) 



2. The nature of citizenship education courses In the soda! 
studies curriculum (cJestlon *2) 



3. The recommended "core" citizenship appf .ach for 
separate courses In citizenship education 
(question * 19) 

4. The least appropriate citizenship approach for separate 
courses In citizenship education (question *20) 

5. The preferred citizenship approaches according to grade 
levels of Instruction (questions *21, 22, & 23) 

Item: 

QUESTION*! 

At what age level(s) should children receive, specif 1c instruction in 
citizenship? (3-5 years, 6-8 years, *9-12 years, 13-15 years, 16-18 
years) 

* The questionnaire mistakenly read 10-12 years, and 9 was inadvertently 
left out of this question. 
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Survey Result: 

(see chart on Question *1 ) 



inferences: 

Citizenship education should begin at about age six and continue, 
throughout the students' k-12 education. 

Item: 

QUESTION #2 

Should citizenship be taught primarily as a separate social studies subject 
or as an integrated part of the regular social studies curriculum? 
(Elementary - Please select one: taught as a separate subject, Taught as 
an integrated subject — Secondary - Please select one: Taught as a 
separate subject, Taught as an integrated subject) 

Survey Result: 

(see chart on Question *2) 

Inferences: 

An overwhelming majority of respondents believe that citizenship 
education should be taught as an Integrated part of the social studied 
curr iculum and not as a separate program or course of study. 

Item: 

Question*! 9 

If these eight approaches were included in a separate citlzenshlp/xourse, 
which approach(es) should serve as the "core" or the course? (please 
select one or more: followed by a list of the eight approaches) 

Survey Result: 

(see chart on Question* 19) 

inferences: 

The ranking of the eight approaches to serve as a "core" 1 for a separate 
citizenship course, is: 

1. "CJVic participation and civic-action" 

2. "Study of American history, civics, geography, and related social 
sciences" 



3. "Scientific thinking" 
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4 "Preparation for global interdependence" 

5. "Contemporary Issues and current events" 

6. "Humanistic development" 

7. "Jurisprudence process" 

8. "Persuasion, socialization, and Indoctrination" 

Item- 
Question *20 

If these eight approaches were included in a separate citizenship course, 
which approaches) should be el.1minated.from the course? (please select 
one or more: followed by a listing of the eight approaches) 



Survey Result: 

(see chart on Question *20) 

Inferences: 

I. "Persuasion, socialization, and indoctrination" would be eliminated by 
the, majority c ;soclal studies methods Instructors if they were to develop 
a separate course of study in citizenship education. 

• 2. "Humanistic development" would be eliminated by a minority of social 
studies methods instructors if they were to develop a separate course of 
study In citizenship education. 

3. All other approaches would be eliminated by a few social studies 
methods instructors, with the exception of "civic participation and civic 
action." 

4. Xivic participation and civic action" would be included in "every" 
separate citizenship course developed by social studies methods 
instructors. 

Item: 

Questional 

irthese eight approaches were included in a separate citizenship course, 
which approaches), should be the domininant approach. of the elementary 
school? (please select one or more: followed by a 11st of the eight 
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approaches) 



Survey Result: 

(see chart on Question *21) 

Inferences: 

1. "Civic participation and civic action" should be the dominant 
citizenship approach. 

2. "Humanistic.development" should be a very Important citizenship 
approach. 

3. "Study of American history, civics, geography and related social 
sciences" and "preparation for global Interdependence" should be Important 
citizenship approaches. 

4 "Contemporary issues and current events," "scientific thinking" and 
"persuasion, socialization, and Indoctrination" should receive a moderate 
amount of consideration. 

5. "Jurisprudence process" may not be an appropriate citizenship approach. 
Item: 

Question *22 

If these eight approaches were included in a separate citizenship course, 
which approach(es) should be (the) dominant approach(esiof the junior 
high school? (please select one or more: followed by a list of the eight 
approaches) 

Survey Result: 

(see chart on Question *22) 

Inferences: 

For a separate citizenship course for the Junior high: 

1. "~''lc participation and civic action," "contemporary Issps and current 
events;" "Study of American-history, civics, geography and related social 
sciences" should be the dominant citizenship approaches. 

2. "Preparation for global Interdependence," "humanistic development," anc 
"scientific thinking" should be important citizenship approaches. 

3. "Jurisprudence process" should be of moderate importance. 
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4 "Persuasion, socialization, and Indoctrination" should be of minor 
Importance. 

Item: 

Question # 23 

If these eight approaches were included In a separate cttlzenshlpxourse, 
which approach(es) should be the dominant approach(es) of the senior high 
school? (please select one or more: followed by a list of the eight 
approaches* 

Survey Result: 

(see charfcoh Question *23) 

Inferences: 

For a/separate citizenship course In the high school: 

1. "Civic participation and civic action" should be the dominant approach 
in a separate citizenship course, 

2. "Contemporary issues and current events 1 should be a very Important 
approach In a separate cltlzensh.p course. 

3. "Preparation for globallnterdependence" and "scientific thinking" 
should be Important approaches in.a separate citizenship, course. 

4 "Jurisprudence process" and "humanistic deveiopmenrshould pe-gl'ven 
some consideration as approaches in.a separate f citlzensh f - course. 

5. "Persyasion, socialization, and indoctrination** should be given little if 
any consideration in a separate citizenship course. 

DISCUSSION: 

' I . The appropriate age to begin citizenship education 
Instruction (question *l) 

Citizenship education for children younger than six years of age is 
open to question and Is generally supported by the majority of 
respondents.;Sut th\? nature of thfi issue Is unclear. Children younger than 
five years of age may be outside of what respondents accept as the domain 
of Vormal education institutional operations. 
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While slight, there appears to be some indication that students in the 
ten to twelve year age category are considered stronger candidates for 
citizenship education programs than students at earlier or later age 
categories; however, this inference is not statistically significant. 

2. The nature of citizenship education courses In the social 
studies curriculum (question *2) 

The reasons for these results is not clear from the responses on the 
questionnaire; however, the following speculations may help to clarify the 
se responses: 

1. The result may be due to a strong belief that is held by 
respondents that every aspect of the social studies curriculum should 
include aspects of citizenship education. 

2. it may indicate that according to tradition, citizenship education 
generally has not been considered a separate course of study. 

As a result of thete speculations, it seems that there is need for explore 
these issues as a means of finding a reasonable justification the 
overwhelming opinion against the use of separate courses and programs in 
citizenship education. 

3. The recommended "core" citizenship approach for 
separate courses In citizenship education 
(question * 19) 

According to our sample, most respondents would not develop 
separate courses and programs in citizenship education. If such a course 
or program were to be developed, it would be built around "civic 
participation and civic action" with strong supporting roles played by 
"social study disciplines" and "scientific thinking." In addition, current 
events and the study of global and international affairs would be 
important aspects of the course. 

We have concluded that many of the ideas and approaches that were 
emphasized in older social studies perspectives (progressive education 
and the "new social studies" movement) are still alive in the minds and 
hearts of the respondents, as expressed in their preference to combine 
civic participation and action with the study of disciplines and "scientific 
thinking." Evidently, there is a consensus among social studies educators 
that is stronger than previously thought. 

4. The least appropriate citizenship approach for separate 
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courses In citizenship education (question *20) 



The respondents have asserted that "persuasion; socialization, and 
Indoctrination" should not be included if a separate course in citizenship 
were to be developed for the social studies curriculum. While the 
respondents are undoubtedly aware of the role of this approach in the 
social development of students, they have systematically demonstrated 
that they would like to rid the social studies curriculum of this approach. 

The fulfillment of this desire probably is not possible or practical in 
light of the needs and requirementsof American society. Indeed, if one 
were to survey and make scientific observations of the operations of the 
classroom and the actual approaches used by teachers for citizenship 
development regardless of the society, "persuasion, socialization, and 
indoctrination" would likely be found playing a key and necessary role in 
the socialization and education of children. 

5. The preferred citizenship approaches according to grade 
levels of Instruction (questions *2I, 22, & 23) 

Elementary school: 

While "civic participation and civic action" continues to be the 
dominant citizenship approach of choice, "humanistic development" and the 
"study of American history, civics, geography and the related social 
sciences" were considered of great Importance for the citizenship 
education of young students. The importance of "humanistic 
development," may reflect the concern of social studies educators for a 
perceived need for American society to nurture and care for the welfare of 
young students. In other words, besides meeting the educational needs of 
the students, the elementary school should be an intervening social 
Institution that addresses the legitimate social needs of its students. 

Junior high school: 

While "civic participation and civic action" remains the recommended 
dominant citizenship approach if a separate citizenship course were to be 
planned, respondents indicated some changes for the Junior high school. 
There has been a shift away from "humanistic development;' which was 
important in the elementary school, towards a dominant role for 
"contemporary issues and current events" in the junior high school. The 
"study of American history, civics, geography, and related social sciences" 
and "preparation for global interdependence" continue to hold their own in 
terms of their perceived importance for both the elementary school and 
the Junior high school. 
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Senior high school: 

90 9 7 



While "civic participation and ciyic action" remains the recommended 
dominant citizenship approach if a separate citizenship course were 
planned, respondents continued to support the "study of American history, 
civics, geography and related social sciences," "contemporary issues and 
current events," and "preparation for global interdependence." The most 
dramatic change comes with increased importance of "scientific thinking" 
as a citizenship approach for high school students. "Scientific thinking" as 
a citizenship approach gains an increment of support from the elementary 
school to the junior high school and another increment of support from the 
Junior high school to the senior high school. In a similar fashion, 
"humanistic development" loses an increment of support from the 
elementary school to the Junior high school and another increment of 
support from the Junior high school to the senior high school In addition, 
"persuasion, socialization, and indoctrination" loses an increment of 
support from the elementary school to the Junior high school and another 
increment of support from the Junior high school to the senior high school. 
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VI. ISSUES AND INFLUENCES RELATED TO CLASSROOM 
INSTRUCTION WITH CITIZENSHIP EDUCATION CONTENT 

Effective instruction with citizenship content Is an Important 
subject to everyone concerned with students' citizenship development. 
This concern includes the selection of Instructional materials, the use of 
instructional methodologies, the nature of the teacher student 
relationship, and the ways that basic values are presented to students In 
order to explore the instructional aspect of citizenship education, a pool 
of questions was developed to address the following concerns: 

1. The most effective Instructional strategydes) with 
citizenship education content (question *7) 

2. "he most Important teacher attrlbute(es) for teaching 
i tlzenshlp education (question *9) 

3. The perceived role and function of Indoctrination In 
citizenship education Instruction (question *10) 

4. The perf erred Instructional approach(es) of methods 
Instructors and methods Instructors' perceptions of 
student preferences (question * 15 & 17) 

5. The preferred Instructional approach(es) for citizenship 
education contained within college level social studies 
method textbooks (question *18) 

Item: 

Question *7 

What teaching strategydes) Is (are) most compatible with the citizenship 
education content? (please rank order: lecture, small group work, 
discussion, Inquiry, simulation, role playing, other) 

Survey Result: 

(see chart on Question * 7) 

Inferences: 

It may be Inferred from the respondents' preferences that: 
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1. "Discussion" and "inquiry" are seen as the most compatible teaching 
strategies to be used with citizenship education content. 

2. "Lecture" is seen as the least compatible leaching strategy to be used 
with citizenship education content. 

3. "Small group work," "simulation," and "role playing" are seen as 
compatible teaching strategies to be used with citizenship education 
content. These strategies received approximately equal rankings in terms 
of first through last place; however, "Role playing" received more last 
place rankings than the others, followed by "simulation." 

4 There was a notable absence of alternative instructional strategies 
identified by the category "other." This may indicate that the six 
identified categories satisfied the preferences of the respondents. 



Item: 

Question *9 

What is the most important teacher attribute for effective instruction in 
citizenship education? (please select one: knowledge of government, 
exemplary behavior, concern for students, classroom organization and 
approach) 

Survey Result: 

(see chart on Question * 9) 

Inference: 

1. "Classroom organization and approach" is perceived by respondents as 
the most important of the four teacher attributes for effective instruction 
in citizenship education. 

2. While not as strong, it was statistically significant that "exemplary 
behavior" was considered an important teacher attribute for effective 
instruction in citizenship education. 

3. Respondents also recognized that "knowledge of government" and 
"concern for students" were Important teacher attributes for effective 
instpjctlon in citizenship education. 

Item: 

Question *10 

What role(s) should indoctrination play in citizenship education? (please 
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select one: none, to teach basic American values, to teach patriotic 

Ideals, to teach national history, to socialize the chil? into the American 

way of life, to achieve some degree of national unity) 

Survey Result: 

(see chart on Question * 1 0) 

Inferences: 

1. By a large statistical margin, the respondents generally agreed that 
Indoctrination should not play any significant role in the processes of 
citizenship education in the schools. 

2. There was a minority perspective that would use indoctrination as a 
means "to teach basic American values," "to socialize the child into the 
American way of life," and "to achieve some degree of national unity." 

3. Using indoctrination "to teach patriotic ideals" and "to teach national 
history" was generally rejected by respondents. 

Item: 

Question*! 5 

Rank order the eight approaches according to your preference, (a list of 
the eight approaches followed the item) 

Survey Result: 

(see chart on Question* 15) 

Inferences: 

1. "Civic participation and civic action" is the preferred citizenship 
approach of social studies methods instructors. 

2. "Contemporary Issues and current events" is the second preferred 
citizenship approach of social studies methods instructors. 

3. "Scientific thinking" is the third preferred citizenship approach of 
social studies methods instructors. 

4 "Preparation for global interdependence" Is the fourth preferred 
citizenship approach of social studies methods instructors. 

5. "Study of American history, civics, geography, and related social 
sciences" is the fifth preferred citizenship approach of social studies 
methods instructors. 
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6 "Humanistic development" is the sixth preferred citizenship approach of 
social studies methods instructors. 

7. "Jurisprudence process" is the seventh preferred citizenship approach 
of social studies methods instructors. 

8. "Persuasion, socialization, and indoctrination" is the eighth preferred 
citizenship approach of social studies methods instructors. 

Item: 

Question*! 7 

Rank order the eight approaches according to student preferences, (a list 
of the eight approaches followed the item) 

Survey Result: 

(see chart on Question * 1 7) 

Inferences: 

The rank-ordering of students' preferences is thus: 

1. "Civic participation and civic action" 

2. "Humanistic development" 

3. "Study of American history, civics, geography, and related social 
sciences" 

4 "Contemporary issues and current events" 

5. "Jurisprudence process" 

6. "Persuasion, socialization, and indoctrination" 

7. "Scientific thinking" 

8. "Preparation for global interdependence" 
Item: 

Question*! 8 

Which of the eight approaches is most commonly described in your 
methods textbook? (please select one: a list of the eight approaches 
followed the item) 
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Survey Result: 

(see chart on Question *18) 



Inferences: 

1. "Scientific thinking" Is the most commonly described citizenship 
approach In social studies methods textbooks. 

2. "Study of American history, civics, geography and related social 
sciences" Is the second most commonly described citizenship approach in 
social studies methods textbooks. 

3. "Civic participation and civic action" is the third most commonly 
described citizenship approach in social studies methods textbooks. 

4 "Contemporary issues and current events" is the fourth most commonly 
described citizenship approach in social studies methods textbooks. 

5. "Persuasion, socialization, and indoctrination," and "jurisprudence 
process" are seldom described citizenship approaches In social studies 
methods textbooks. 

6. "Preparation for global interdependence" is the least commonly 
described citizenship approach in social studies methods textbooks 

DISCUSSION 

1. The most effective Instructional strategy(les) with 
citizenship education content (question *7) 

"Discussion" and "Inquiry" seem to stand out statistically 
as the most compatible teaching strategies to be used with 
citizenship content. The reason for selecting these strategies as 
most compatible is open to speculation. It may be that these 
strategies are seen as going beyond a simple pedagogical function 
such as the transmission of knowledge to a more substantive function 
In the development of citizenship. While "lecture" may serve a 
useful but simple pedagogical function In terms of the transmission 
of knowledge, it may contribute very little to the substantive 
function of citizenship development. 

2. The most Important teacher attrlbute(es) for teaching 
citizenship education (question *9) 

When these four choices were considered," the respondents had 
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a clear preference for "classroom organization and approach." While 
this factor was not described or defined, the respondents most 
likely had a model or "Ideal" classroom situation or teacher In mind. 
While we can only speculate about this "Ideal" classroom or 
classroom teacher, classroom behaviors associated with teacher 
effectiveness undoubtedly play a major role In effective Instruction 
In citizenship education. 

3. The perceived role and function of indoctrination In 
citizenship education Instruction (question * JO) 

Clearly, the term "Indoctrination" was considered unacceptable 
to the majority of respondents. While the term was not described. or 
defined, It met with a universal rejection. "Indoctrination" as applied 
to citizenship education In American society Is unacceptable; 
however, this rejection does not Indicate that the use of 
Indoctrination In the classroom does not exist, nor does It, 
encourage the use of Indoctrination In citizenship development. 
Perhaps more than anything else, this reaction was a commentary, on 
the generally perceived nature of our educational values as they 
pertain to American society. 

4. The preferred Instructional approach(es) of methods 
Instructors and methods Instructors perceptions of 
student preferences (question * 15 & 17) 

Methods Instructors' preferences: 

The respondents' preferences for the citizenship approaches 
continue to support a perspective In which "civic participation," 
"contemporary Issues and current events," "scientific thinking," and 
"preparation for global Interdependence" are seen as the best 
combination of approaches for citizenship education. It Is interesting 
to note that the "study of American history, civics, geography, and 
related social sciences," "humanistic development," and 
"Jurisprudence process" were In the middle and towards the end of the 
rank ordered preferences. It was not surprising to find that 
"persuasion, socialization, and Indoctrination" was at the bottom of 
the rank ordered preferences In light of a continuous and consistent 
rejection of this approach. 

Perceived student preferences: 

The respondents Identified "civic participation and civic 
action," "humanistic development, " study of American history, civics, 
geography, and related social sciences," and "contemporary Issues and 
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current events" as the citizenship approaches that students preferred 
most. "Jurisprudence process," "persuasion, socialization, and 
indoctrination," and "scientific thinking" were ranked near the bottom 
of student preferences; "Preparation for global interdependence" was 
identified as the least student preferred of the eight citizenship 
approaches. This rather dramatic change in the respondents' rankings 
of the citizenship approaches is an interesting break in the patterns 
of responses that have emerged from the survey. It may be an 
indication of a gap that exists between ideological perceptions and 
desires of scholars coupled with their realization of the needs and 
practices of the social studies classroom. 

5. The preferred Instructional approach(es) for citizenship 
education contained within college level social studies 
methods textbooks (question *18) 

According to the respondents, "scientific thinking" and the 
"study of American history, civics, geography, and related social 
sciences" are the most commonly described; citizenship approaches in 
the social studies methods textbooks. We hope that the researchers 
have not misled the respondents on this question; however, it has 
been our experience to note that while these approaches are 
commonly described in connection with the social studies, most 
textbook authors describe, citizenship in a general, way and do not 
recommend specific citizenship approaches. In other words, all of the 
above eight components, along with citizenship, are included in most 
social studies textbooks, but specific approaches are seldom if ever 
directly connected with citizenship education. One 
exception is that citizenship education Is commonly identified and 
described primarily in connection with political science and 
government. We see citizenship as the primary goal of social studies 
education; therefore, it would serve as the "core" around which all 
other aspects of social education would be built. 
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VI. CONCLUSIONS AND RECOMMENDATIONS 

Theresults of the CUFA survey are still being analyzed, and new 
Insights are continuing to surface. Because citizenship education is a 
complex and abstract social phenomenon, the results of this complex 
survey continue to raise questions that cannot be resolved without further 
Inquiry. In addition, citizenship inquiries are exceedingly transitory 
because they are affected by the changing moods and currents that affect 
society as a whole. As a result, this type of Inquiry can be considered 
historical rather than definitive. In spite of this problem, much can be 
learned, and this new knowledge can be used to help the schools to do a 
more adequate Job In meeting the needs of society In regard to citizenship 
education. 

General Conclusions: 

The Importance of the CUFA exploratory study lies in the effect that 
it has in clarifying and directing future scientific studies. As a result of 
this exploratory study, the following general conclusions emerged: 

!. The eight citizenship approaches can be considered a generally 
comprehensive set of Instructional methods used in the training of social 
studies teachers in citizenship education. 

2. CUFA members tend to be consistent in their preferences for 
certain citizenship approaches over certain other approaches regardless of 
grade level or the conditions of instruction. 

3. The application of citizenship instructional approaches and 
emphasis tends to shift and change to some extent according to student 
age and maturity. 

4 While there does not seem to be a consensus of agreement 
regarding the role or the direction of citizenship education in the social 
studies, there does seem to be a general pattern of agreement about 
various aspects of citizenship education. 

5. The use of certain terms and phrases, such as "Indoctrination" and 
"the acceptance of authority," tend to trigger negative responses among. 
CUFA respondents while net necessarily indicating a in-depth 
disagreement. 
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6. It seems that there is. a dichctomous division among CUFA 
members who prefer either a greater or a lesse^role for citizenship 
education within the schools. 

7. The most direct effect of the CUFA survey has been tne 
re-examination and modification of the direction and goals of project 
researchers. 

General Recommendations: 

As a result of the CUFA survey, project researchers were able to 
identify and begin work on the next phase of project research. The most 
Important recommendation originating from the CUFA survey was to shift 
the focus away from teacher education and move directly into the school 
environment in order to identify and attempt to measure what transpires 
within the school in regard to citizenship education. As a result of the 
CUFA exploratory study, the followinr yere recommended: 

1 . Development of new research Instruments that were designed to 
explore citizenship influences on students i connection with their 
educational experiences. 

2. The simplification and shortening of the survey Instruments. 

3. To develop survey instruments based on a Likert-type scale. 

4. To develop additional survey instruments for teachers, school 
administrators, and parents. 

5. The pilot testing of Likert-type scales in order to Identify and 
measure influences that affect citizenship development. 

6. The development of a working relationship with school districts 
throughout the United States in order to administer new survey 
instruments. 

7. T>te measurement of student perceptions regarding their 
citizenship education experiences. 

8. The comparison of school district survey results in regard to 
geographic, social, and cultural differences. 

9. The development of a Likert-type scales t© measure the attitudes 
and practices of social studies r ethO-S instructors. 
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Summary: 

The original CUFA survey Instrument helped to provide the means 
whereby new and more specific Instruments could be developed. In 
addition, the Insights learned In connection with the CUFA survey were 
valuable In the Identification of critical issues regarding citizenship 
education that simply were not available from current knowledge prior to 
the survey. While a great deal has been written about citizenship 
education, few reports or articles based upon field research exist. The 
CUFA survey was an exploratory attempt to gain new insights into the 
status of citizenship education in the schools. The results of this initial 
survey has been extremely helpful as a source of direction and 
clarification for future studies. 
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APPENDIX 

THE ANALYSIS OF DATA 

The analysis of data required several processes in order to 
accommodate the types of items included in the questionnaire. These 
processes included the following: 



Coding: 

In preparing the questionnaires for analysis, each response was coded 
to a standardized index. If the total number of responses was eight or 
less, integer values were assigned. For some questions, multiple 
responses were possible and a more elaborate coding scheme was 
employed. In questions requiring a ranking of the elements, the ranks were 
the coded values. Similarly, questions having dlchotomous responses, e.g. 
yes/no, had the responses coded 1 and 2 for yes and no respectively. For 
those several questions which allowed multiple responses, the items were 
divided into groups of four in which the presence of a mark was construed 
to be a binary bit in the coding as a hexadecimal (base sixteen) digit. In 
the analysis, these values were unpacked and counted, yielding the 
frequency of occurrence among the survey responses. In a subsequent part 
of the analysis, these coded values were used to identify any significant 
mixes that were present. A computer programwas written to faciliate 
the counting task. The resulting frequency distributions provided the 
basis for the conjectures as well as for the graphics which have been 
produced. 

Data Encoding: 

To facilitate the analysis of the questionnaire, each question had its 
response coded to a numerical value. For each invalid or no response, a 
code value of 0 (zero) was given. This applied to every question or item on 
the questionnaire. In general, the items or questions can be placed in one 
of four categories. The coding of each of these is considered separately. 

I. Dlchotomous responses, typically yes/no. The code used in this 
case was I (one) for a yes and a 2 (two) for a no. Using only the valid yes 
and no responses, a projected probability of a yes answer and an 
associated confidence interval could then be calculated. In some of the 
preliminary results, a strong bias was observed, leaving some question as 
to whether a binomial model, as was used, was the best. 
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2. Selecting one response from a family of choices. In this case each 
response was assigned an integer value, starting at one and subsequently 
labeling each additional item as 2, 3, ... etc. Because one item was to be 
selected, the.coded value recorded was the item number. Care must be 
exercised in not interpreting the ordering of the listed items as a ranking. 
From an instrument design, it would be desirable to randomize the items 
to be selected in their presentation to the various respondents, but this 
was not done. From this code a frequency count of the responses was 
obtained, leading to some conjectures as to which are typical responses 
and/or whether there is any pattern to the responses. The introduction of 
a category called "other" (category on questionnaire items and illustrated 
on the charts) leads to other problems, particularly when the choice is not 
identified. When defined in the preliminary investigation, these choices 
can be used to improve the survey instrument. 

3. Other questions asked for multiple choices of the listed items. By 
allowing multiple choices, the disadvantages of ranking is minimized, but 
the problem of association is introduced For the instrument at hand, 
these questions had only eight (8) different choices. To facilitate the 
storage of data and still provide for retrieval of the associations, the 
lists were divided into groups of 4. Each item selected was marked with a 
1 and this value was construed to be a binary bit. The unselected items 
were assigned a value of zero. Working with groups of four, these bit 
arrays were then coded to the corresponding hexadecimal (base 16) digit 
(0. 1, 2, 3, . . . ,F) according to the following scheme: 

Item 

10000000011 11 ] 1 1 1 

2000011110000 1 I 1 1 

300110011. 0 0 1 1 00 1 1 

40101010 101 0 1 0 1 0 1 



Code 0123456789ABC DEF 

The same coding was used on the last four items in the question. For an 
eight item question, all of the recorded information could be stored in a 
two-digit number. 

To illustrate the use of this code, note that If the first and third 
Items had been selected, the coded value assigned to these responses 
would be A. Had all items been selected, the code would be F. Had only the 
second item been chosen, the code would be 4. Through the use of 
computer programs, these responses can be summarized as individual 
frequencies or reduced to a table illustrating the various associations. 
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4. The last category of responses asks the responder to rank the 
Items under investigation. The individual Items were simply coded 
according to the rank value given to them. In summarizing the data, the 
frequency of occurrence In each rank was obtained, providing some 
preliminary Insights into distribution patterns. Subsequent analysis was 
used In an effort to define or better determine potential rank differences. 

Statistical Analysis 

The data of each frequency table was subjected to an elementary 
statistical analysis of the following types: 

Dlchotomous responses (Clopper-Pearson confidence interval) 

in those questions having a dlchotomous (two value) response, an 
estimate of the proportion yielding one of the two was made.. In making 
this estimate, only those frequencies contributing to a valldresponse 
were used. As a measure of variability, the Clopper-Pearson confidence 
Interval was to be calculated, but due to the large sample sizes Involved, a 
normal approximation was used. In each case a 95% confidence Interval 
was calculated. This procedure was employed on questions 6 and 24 
respectively. Under the assumption that the sampling of the population Is 
representative, this 958 confidence Interval provides Insight into the 
Interval in which the true population response should lie. The 95% 
confidence interval Is equivalent to acknowledging that a 5% chance exists 
that the true population estimate may He outside the specified interval. 

Multiple and single responses (Chl-square goodness of fit) 

Questions 3, 4, 5, 9, 10, 1 1, and 12 allowed for single responses, 
while questions 19, 20, 21, 22 and 23 allowed for multiple responses. On 
Investigating these questions, the primary hypothesis considered was 
whether or not all items In the question had statistically the same 
associated frequency of acceptance. This hypothesis was addressed 
through the Chl-square goodness of fit test, using the assumption of the 
response being uniformly distributed. On observing the data In many of the 
questions it was apparent that the distribution Is not uniform. Risking the 
possibility of being accused of manipulating the analysis, elements which 
had relatively few respondees selecting them were deleted from 
consideration. In these cases the remaining elements were tested for 
uniformity of selection. The reason for doing this was to make a 
preliminary attempt at categorizing the elements Into groups which could 
be considered as being equivalent in the perception of the respondees. 

Determination of rankings (Page's adaptation of Friedman Rank Sums) 
Another type of statistical analysis performed on certain Items 
Involved the determination of the rankings of the several elements in the 
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questions. Each respondee ranked the elements, leaving the problem of 
determining an overall or composite ranking. This was accomplished by 
using a Distribution-Free test for Ordered Alternatives based on Page's 
adaptation of Friedman Rank Sums. Ranks only provide an ordering and 
yield no information as to how close two ranking values are. The analysis 
used here is an attempt to provide a ranking and again identify potentially 
some sort of an equivalence of ranking among those elements which appear 
to He close together. The first stage in the analysis was to calculate a 
weighted rank from all of the rankings and Inputs to the question. These 
rankings were then ordered and subjected to the non-parametric test to 
determine If there were any strict ordering between the values. 
Unfortunately, If the test reveals the existence of a strict ordering, It 
does not Indicate where the break occurs, or if there Is more than one. At 
this stage a subjective assessment of the rank orders and equivalences 
was made. Further research will be needed to determine or validate the 
subjective determinations made. 

Pattern search (contingency groupings in arrayed patterns) 

The final analysis employed was to take the coded data associated 
with the questions haying multiple responses — questions 1 3, 1 4, 1 9, 20, 
21, 22, and 23 — and use the coded Information which Illustrated 
contingency groupings as originally returned. These associations could 
take on any of 256 patterns. These patterns Included all possibilities 
ranging from no selection, through selections of only one attribute, then 
two attributes, etc. and finally including all eight attributes. This search 
considered all response patterns to see If any subset occurred frequently 
enough to warrant investigation and discussion. 

IMPLICATIONS OF THE SURVEY 

The Investigation of many fields of human endeavor are such that It is 
not possible to obtain, definitive conclusions as to the understanding of 
those elements Involved and the Implicit relationships that exist. Part of 
the problem lies in the Inability of having a closed society, uninfluenced 
by external and often unknown forces. This alone creates some problems 
In attempting to define a population, and the selection of a suitable 
representative sample. 

A second and equally Important problem Is that of Identifying and 
stating well-defined research hypotheses which can be investigated. 
Developing well defined problem statements has always been one of the 
major obstacles to research. One Illustration of this is the formulation In 
the I890's of St. Venant's principle In elasticity theory. All agreed that 
the principle must be true, and It was used in much subsequent research. 
It was not until the 1950's that the principle was well formulated and 
ultimately demonstrated to be true. For this to happen in the "hard 
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sciences" should help those of us working in the social sciences appreciate 
the problem of making well formulated research statements. 

One step in the development of well formulated research problems 
involves techniques of exploratory studies. There are several objectives 
of an exploratory study, some of which are these: 

1. Test the sampling instruments to see if they provide 

data which is potentially useful for the initially formulated 
problem. 

2. Test the sampled data for its usefulness in the 
analysis and testing of the original conjectures. On 
occasions it has been found that the data obtained from the 
research instrument is unsuitable for analysis. 

3. Provide a basis for revising the original conjectures into 
hypotheses that can be sensibly investigated. 

One disadvantage of an exploratory study* is the result of what we 
shall call the "Heisenberg Principle." in physics, the Heisenberg Principle 
states that you cannot know the position and the velocity of a particle at 
the same time, for in obtaining the measure of one, you disturb the 
particle and the measure of the other is no longer at it was. This same 
concept applies to social research, for in performing an initial sampling, 
the raising of the questions, even to a select group, can bring about a 
self-evaluation and a subsequently new position. Since people are . 
involved, and people are social beings, it is possible that some of these 
influences can carry beyond the circle of those initially involved. 

In this study of citizenship education, similar problems have risen, 
foremost of which is an attempt to specify a definition of 'citizenship 
education. Other questions to be investigated involve the use of teaching 
strategies and the attitudes of educators towards citizenship education. 

The preliminary survey addressed some of these questions but not in a 
way that necessarily provided measurable responses. The questionnaire 
responses predominately asked for a yes/no response to a single item or a 
selection of different possible responses, or asked for a ranking. In some 
cf the yes/no response questions, only one yes was acceptable; on others, 
multiple yeses were acceptable. No provisions for ties were given in the 
instrument for those questions in which only one item was to be selected. 
In a few cases, respondents felt that a single choice was not possible and 
so checked two, providing an invalid response. 

The problem of ranking responses provides an even more complex 
situation. For example, an individual can easily identify their top choices 
and probably rank them. Similarly the bottom choices can be ranked. The 
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difficulty lies with the items In the middle, with these there usually is 
not a clear perspective of how the Items should be ranked. To confound 
matters more, ranking Is an ordinal relation and as such, there Is no way 
of determining how closely two ranks were Intended on the part of the 
respondent. This problem could be partially resolved by using a Llkert 
scale (Rensls Llkert) which Is used to measure an attitude on a 7 or 9 
point scale. On occasions, no scale values are given Initially, but are 
measured from the marking after the fact and summarized over the set of 
responses. This reference presents additional problems related to the 
encoding of the data for analysis. 

For many of the items there were eight items to be ranked. To 
minimize the effects of no distance being defined between ranks, the 
summaries were pooled into adjacent groups of 1 and 2, 3 and 4, 5 and 6, 
and 7 and 8. This, however, did not circumvent the potential problem of a 
rank 1 by one responder being equivalent to a rank of say 3 on the part of 
another. The use of a Llkert scale could help to minimize this problem. 

Once these rankings are summarized, they can be tested statistically 
to determine whether they follow any particular "a priori" distribution. It 
Is at this point that the preliminary Investigation can be helpful. Even 
though the data itself may be unrepresentative, it can be used to project a 
given distribution of responses. For the case at hand, a simple Chi-square 
test was used to test for the presence of a uniform distribution, but this 
was done only as an example of what could be done. Once a distribution 
function is targeted, two additional questions need to be addressed. The 
obvious and more familiar one is "Does the data support the underlying 
presence of this distribution?" The second question is more fundamental 
and frequently overlooked. This .question asks If there Is any theoretical 
basis for justifying the proposed distribution. In resolving this question, 
one gains Insight Into the entire structure and again better formulates the 
research hypotheses to be Investigated. 
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